`ACCESS-OM2` Dependencies Update #60

CodeGat · 2024-04-26T04:04:46Z

Updated compiler to intel@2021.6.0, updated package versions

Related issue #61 (doesn't close until compiler is also updated to OneAPI version, ifx)

…2024.04.23

github-actions · 2024-04-26T04:05:41Z

This access-om2 model will be deployed with the following versions:

2024.04.0 as a Release (when merged).
pr60-4 as a Prerelease (during this PR). This can be accessed on Gadi via spack at /g/data/vk83/prerelease/apps/spack/0.20/spack once deployed.

It will be deployed using:

access-nri/spack-packages version 2024.04.20
access-nri/spack-config version 2024.04.23

If this is not what was expected, commit changes to config/versions.json.

github-actions · 2024-04-26T04:12:29Z

This access-om2 model will be deployed with the following versions:

2024.04.0 as a Release (when merged).
pr60-4 as a Prerelease (during this PR). This can be accessed on Gadi via spack at /g/data/vk83/prerelease/apps/spack/0.20/spack once deployed.

It will be deployed using:

access-nri/spack-packages version 2024.04.20
access-nri/spack-config version 2024.04.23

If this is not what was expected, commit changes to config/versions.json.

github-actions · 2024-04-26T04:55:33Z

This access-om2 model will be deployed with the following versions:

2024.04.0 as a Release (when merged).
pr60-5 as a Prerelease (during this PR). This can be accessed on Gadi via spack at /g/data/vk83/prerelease/apps/spack/0.20/spack once deployed.

It will be deployed using:

access-nri/spack-packages version 2024.04.20
access-nri/spack-config version 2024.04.23

If this is not what was expected, commit changes to config/versions.json.

github-actions · 2024-04-26T06:22:38Z

This access-om2 model will be deployed with the following versions:

2024.04.0 as a Release (when merged).
pr60-6 as a Prerelease (during this PR). This can be accessed on Gadi via spack at /g/data/vk83/prerelease/apps/spack/0.21/spack once deployed.

It will be deployed using:

access-nri/spack-packages version 2024.04.20
access-nri/spack-config version 2024.04.23

If this is not what was expected, commit changes to config/versions.json.

harshula · 2024-04-29T01:28:24Z

Dependencies:
ACCESS-NRI/spack-config#28
ACCESS-NRI/spack-config#29

harshula · 2024-04-29T05:35:58Z

Hi @CodeGat , Should we also use Spack v0.21 instead of v0.20?

CodeGat · 2024-04-29T05:37:44Z

It is using that version - if you have access, check the vars in the Gadi Prerelease environment setting - they're pointing to the 0.21 prerelease spack on Gadi

aidanheerdegen · 2024-04-30T23:28:30Z

Am I correct, updating all those dependencies didn't change bit reproducibility?

CodeGat · 2024-05-01T00:14:03Z

I don't know if we'd tested the bit repro yet?

aidanheerdegen · 2024-05-01T02:26:12Z

I don't know if we'd tested the bit repro yet?

Yeah that was a mistake on my part.

I've created an issue for that

ACCESS-NRI/access-om2-configs#107

I can make a PR to test it, or if you want to use this as a test for an automated PR workflow that would also be cool @CodeGat

CodeGat · 2024-05-01T03:52:22Z

That workflow might take a bit of thonking to figure out, so I'm happy for this one to be manual!

…onents from include: array as part of #60

github-actions · 2024-05-06T02:50:27Z

This access-om2 model will be deployed with the following versions:

2024.04.0 as a Release (when merged).
pr60-7 as a Prerelease (during this PR). This can be accessed on Gadi via spack at /g/data/vk83/prerelease/apps/spack/0.20/spack once deployed.

It will be deployed using:

access-nri/spack-packages version 2024.04.20
access-nri/spack-config version 2024.04.23

If this is not what was expected, commit changes to config/versions.json.

CodeGat · 2024-05-06T03:06:29Z

Gadi is currently feeling sluggish and is failing to deploy our things. Will wait until it is better, then try again

aidanheerdegen · 2024-06-05T07:13:54Z

I have manually run the repro tests with the release-1deg_jra55_ryf branch, using the binaries from this PR:

$ git diff HEAD^^ manifests/exe.yaml
diff --git a/manifests/exe.yaml b/manifests/exe.yaml
index 0aeb8c6..80ed3f5 100644
--- a/manifests/exe.yaml
+++ b/manifests/exe.yaml
@@ -2,17 +2,17 @@ format: yamanifest
 version: 1.0
 ---
 work/atmosphere/yatm.exe:
-  fullpath: /g/data/vk83/apps/spack/0.20/release/linux-rocky8-x86_64/intel-19.0.5.281/libaccessom2-git.2023.10.26=2023.10.26-ieiy3e7hidn4dzaqly3ly2yu45mecgq4/bin/yatm.exe
+  fullpath: /g/data/vk83/apps/spack/0.20/release/linux-rocky8-x86_64/intel-19.0.5.281/libaccessom2-git.2023.10.26=2023.10.26-ltfg7jcn6t4cefotvj3kjnyu5nru26xo/bin/yatm.exe
   hashes:
-    binhash: 61890159678b68a1699cb989d2c2864e
-    md5: 7bbd1014eb48b16406877d1b93ae1a47
+    binhash: 4e8b4ef76e971c4af3b26cfac632e160
+    md5: 5baa1d417fe6708fc30cbeaa57d82f96
 work/ice/cice_auscom_360x300_24x1_24p.exe:
-  fullpath: /g/data/vk83/apps/spack/0.20/release/linux-rocky8-x86_64/intel-19.0.5.281/cice5-git.2023.10.19=2023.10.19-rh3xfkrgajya3ghtliacuhlx3pgvrzqs/bin/cice_auscom_360x300_24x1_24p.exe
+  fullpath: /g/data/vk83/apps/spack/0.20/release/linux-rocky8-x86_64/intel-19.0.5.281/cice5-git.2023.10.19=2023.10.19-v3zncpqjj2gyseudbwiudolcjq3k3leo/bin/cice_auscom_360x300_24x1_24p.exe
   hashes:
-    binhash: 6bff005e04c23c579f37b7b2c0189793
-    md5: 5e7c7ba864da95cd1329d098f1e47776
+    binhash: 3a65f67d21152e77034da28c22a94c66
+    md5: 37866455b057c85c3ea50c0ef0ea840b
 work/ocean/fms_ACCESS-OM.x:
-  fullpath: /g/data/vk83/apps/spack/0.20/release/linux-rocky8-x86_64/intel-19.0.5.281/mom5-git.2023.11.09=2023.11.09-ewcdbrfukblyjxpkhd3mfkj4yxfolal4/bin/fms_ACCESS-OM.x
+  fullpath: /g/data/vk83/apps/spack/0.20/release/linux-rocky8-x86_64/intel-19.0.5.281/mom5-git.2023.11.09=2023.11.09-qji4nlmr6utrribaiyhewe4je6mifguz/bin/fms_ACCESS-OM.x
   hashes:
-    binhash: c5c24bc2ab515b08e47d6d3ab2b54cc6
-    md5: 2432c23048525b384fd57e8cd2ed7e3b
+    binhash: 92ce1ff1a38f44f92ceafd67e8e7142c
+    md5: a3f10baeadb88e813b4a8121f61a6226

$ model-config-tests -m checksum
============================================================ test session starts =============================================================
platform linux -- Python 3.11.7, pytest-8.2.1, pluggy-1.5.0                            
rootdir: /g/data/tm70/aph502/envs/model-config-tests/lib/python3.11/site-packages/model_config_tests
collected 39 items / 37 deselected / 2 selected                                                                                              
                                     
../../../../../g/data/tm70/aph502/envs/model-config-tests/lib/python3.11/site-packages/model_config_tests/test_bit_reproducibility.py . [ 50%]
.                                                                                                                                      [100%]
                      
================================================ 2 passed, 37 deselected in 685.56s (0:11:25) ================================================

Details of python `venv` used for testing

``` $ pip list Package Version ------------------------- ----------- attrs 23.2.0 certifi 2024.6.2 cftime 1.6.3 charset-normalizer 3.3.2 f90nml 1.4.4 gitdb 4.0.11 GitPython 3.1.43 idna 3.7 iniconfig 2.0.0 jsonschema 4.22.0 jsonschema-specifications 2023.12.1 model_config_tests 0.0.1 nchash 0.1.5 netCDF4 1.6.5 numpy 1.26.4 packaging 24.0 payu 1.1.3 pip 23.2.1 pluggy 1.5.0 pytest 8.2.1 python-dateutil 2.9.0.post0 PyYAML 6.0.1 referencing 0.35.1 requests 2.32.3 rpds-py 0.18.1 ruamel.yaml 0.18.6 ruamel.yaml.clib 0.2.8 setuptools 65.5.0 six 1.16.0 smmap 5.0.1 tenacity 8.3.0 urllib3 2.2.1 ```

Based on the reproducibility and performance testing, I think this should be merged.

spack.yaml

github-actions · 2024-06-05T23:51:40Z

This access-om2 model will be deployed as:

2024.06.0 as a Release (when merged).
pr60-10 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using module use /g/data/vk83/prerelease/modules/access-models/ && module load access-om2/pr60-10, where the binaries shall be on your $PATH.
This Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.21/spack in the access-om2-pr60-10 environment.

It will be deployed using:

access-nri/spack-packages version 2024.04.20
access-nri/spack-config version 2024.04.23

If this is not what was expected, commit changes to config/versions.json.

spack.yaml

aidanheerdegen · 2024-06-06T00:30:59Z

We probably want to update to 2024.06.0 if that is when we're merging the PR.

Or ... we could use 2023.03.1, as we're not updating any model components, and we've since established it is bit repro and doesn't affect performance.

Sorry! And I'm not particularly sold on one over the other.

CodeGat · 2024-06-06T01:10:58Z

@aidanheerdegen Good idea. I'll use 2024.03.1 instead.

github-actions · 2024-06-06T01:16:51Z

This access-om2 model will be deployed as:

2024.03.1 as a Release (when merged).
pr60-11 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using module use /g/data/vk83/prerelease/modules/access-models/ && module load access-om2/pr60-11, where the binaries shall be on your $PATH.
This Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.21/spack in the access-om2-pr60-11 environment.

It will be deployed using:

access-nri/spack-packages version 2024.04.20
access-nri/spack-config version 2024.04.23

If this is not what was expected, commit changes to config/versions.json.

CodeGat · 2024-06-07T03:10:21Z

The above commit is testing out #60 (comment) - it can be removed if it is not needed, and we can go back to 4ed4c7b

github-actions · 2024-06-07T03:25:05Z

This access-om2 model will be deployed as:

2024.03.1 as a Release (when merged).
pr60-12 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using module use /g/data/vk83/prerelease/modules/access-models/ && module load access-om2/pr60-12, where the binaries shall be on your $PATH.
This Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.21/spack in the access-om2-pr60-12 environment.

It will be deployed using:

access-nri/spack-packages version 2024.04.20
access-nri/spack-config version 2024.04.23

If this is not what was expected, commit changes to config/versions.json.

spack.yaml

…n a preference

github-actions · 2024-06-11T04:18:47Z

This access-om2 model will be deployed as:

2024.03.1 as a Release (when merged).
pr60-13 as a Prerelease (during this PR).

This Prerelease is accessible on Gadi using module use /g/data/vk83/prerelease/modules/access-models/ && module load access-om2/pr60-13, where the binaries shall be on your $PATH.
This Prerelease is also accessible on Gadi via /g/data/vk83/prerelease/apps/spack/0.21/spack in the access-om2-pr60-13 environment.

It will be deployed using:

access-nri/spack-packages version 2024.04.20
access-nri/spack-config version 2024.04.23

If this is not what was expected, commit changes to config/versions.json.

CodeGat · 2024-06-26T04:01:08Z

Cleaned up the environment for access-om2-pr60-* with https://github.com/ACCESS-NRI/ACCESS-OM2/actions/runs/9673293454/job/26686980742

CodeGat added 4 commits April 24, 2024 10:57

spack.yaml: Reformatted file

dcb447b

spack.yaml: Blanket bump for all components

8eabdb1

versions.json: Updated spack-packages to 2024.04.20, spack-config to …

742ebbe

…2024.04.23

spack.yaml: Compiler updated to 2021.6.0

bb76f97

CodeGat self-assigned this Apr 26, 2024

CodeGat had a problem deploying to Gadi Prerelease April 26, 2024 04:05 — with GitHub Actions Failure

CodeGat had a problem deploying to Gadi Prerelease April 26, 2024 04:10 — with GitHub Actions Failure

CodeGat had a problem deploying to Gadi Prerelease April 26, 2024 04:12 — with GitHub Actions Failure

spack.yaml: Downgraded to openmpi@4.1.5 as it is not on Gadi yet

ffab2b6

CodeGat temporarily deployed to Gadi Prerelease April 26, 2024 04:55 — with GitHub Actions Inactive

spack.yaml: Updated to intel@2021.10.0

f357de8

CodeGat temporarily deployed to Gadi Prerelease April 26, 2024 06:22 — with GitHub Actions Inactive

aidanheerdegen mentioned this pull request May 1, 2024

Test updated software stack ACCESS-NRI/access-om2-configs#107

Open

CodeGat mentioned this pull request May 1, 2024

Open PRs to associated ACCESS-NRI/<model>-configs repo upon Pre/Release ACCESS-NRI/build-cd#62

Open

spack.yaml: renamed exclude_implicits to hide_implicits, removed comp…

8e8670f

…onents from include: array as part of #60

CodeGat had a problem deploying to Gadi Prerelease May 6, 2024 02:50 — with GitHub Actions Failure

CodeGat had a problem deploying to Gadi Prerelease May 6, 2024 02:56 — with GitHub Actions Error

aidanheerdegen requested a review from harshula June 5, 2024 07:14

aidanheerdegen reviewed Jun 5, 2024

View reviewed changes

spack.yaml Outdated Show resolved Hide resolved

spack.yaml: Updated model version to 2024.06.0

6ab1bd7

CodeGat temporarily deployed to Gadi Prerelease June 5, 2024 23:51 — with GitHub Actions Inactive

harshula reviewed Jun 5, 2024

View reviewed changes

spack.yaml Outdated Show resolved Hide resolved

spack.yaml: Updated version to 2024.03.1 from 2024.06.0

4ed4c7b

CodeGat temporarily deployed to Gadi Prerelease June 6, 2024 01:16 — with GitHub Actions Inactive

spack.yaml: added cppflags arg to openmpi package

f87c8f6

CodeGat temporarily deployed to Gadi Prerelease June 7, 2024 03:10 — with GitHub Actions Inactive

harshula reviewed Jun 11, 2024

View reviewed changes

spack.yaml Outdated Show resolved Hide resolved

spack.yaml: Updated spack.packages.all to be a requirement rather tha…

c49a105

…n a preference

CodeGat temporarily deployed to Gadi Prerelease June 11, 2024 04:18 — with GitHub Actions Inactive

CodeGat requested a review from harshula June 11, 2024 04:37

harshula approved these changes Jun 11, 2024

View reviewed changes

CodeGat merged commit 32ef741 into main Jun 26, 2024
12 checks passed

CodeGat temporarily deployed to Gadi Prerelease June 26, 2024 03:55 — with GitHub Actions Inactive

CodeGat mentioned this pull request Jun 26, 2024

ACCESS-OM2 Dependencies and Compiler Update #73

Merged

CodeGat temporarily deployed to Gadi Prerelease June 26, 2024 05:59 — with GitHub Actions Inactive

CodeGat temporarily deployed to Gadi Prerelease June 26, 2024 07:24 — with GitHub Actions Inactive

CodeGat deleted the om2-dependencies-update branch June 27, 2024 04:25

harshula mentioned this pull request Jul 5, 2024

Modules created by Spack need Module version 4.7 ACCESS-NRI/ACCESS-ESM1.5#8

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

`ACCESS-OM2` Dependencies Update #60

`ACCESS-OM2` Dependencies Update #60

CodeGat commented Apr 26, 2024 •

edited by aidanheerdegen

Loading

github-actions bot commented Apr 26, 2024

github-actions bot commented Apr 26, 2024

github-actions bot commented Apr 26, 2024

github-actions bot commented Apr 26, 2024 •

edited by CodeGat

Loading

harshula commented Apr 29, 2024

harshula commented Apr 29, 2024

CodeGat commented Apr 29, 2024

aidanheerdegen commented Apr 30, 2024

CodeGat commented May 1, 2024

aidanheerdegen commented May 1, 2024

CodeGat commented May 1, 2024

github-actions bot commented May 6, 2024

CodeGat commented May 6, 2024

aidanheerdegen commented Jun 5, 2024

github-actions bot commented Jun 5, 2024

aidanheerdegen commented Jun 6, 2024 •

edited

Loading

CodeGat commented Jun 6, 2024 •

edited

Loading

github-actions bot commented Jun 6, 2024

CodeGat commented Jun 7, 2024 •

edited

Loading

github-actions bot commented Jun 7, 2024

github-actions bot commented Jun 11, 2024

CodeGat commented Jun 26, 2024

ACCESS-OM2 Dependencies Update #60

ACCESS-OM2 Dependencies Update #60

Conversation

CodeGat commented Apr 26, 2024 • edited by aidanheerdegen Loading

github-actions bot commented Apr 26, 2024

github-actions bot commented Apr 26, 2024

github-actions bot commented Apr 26, 2024

github-actions bot commented Apr 26, 2024 • edited by CodeGat Loading

harshula commented Apr 29, 2024

harshula commented Apr 29, 2024

CodeGat commented Apr 29, 2024

aidanheerdegen commented Apr 30, 2024

CodeGat commented May 1, 2024

aidanheerdegen commented May 1, 2024

CodeGat commented May 1, 2024

github-actions bot commented May 6, 2024

CodeGat commented May 6, 2024

aidanheerdegen commented Jun 5, 2024

github-actions bot commented Jun 5, 2024

aidanheerdegen commented Jun 6, 2024 • edited Loading

CodeGat commented Jun 6, 2024 • edited Loading

github-actions bot commented Jun 6, 2024

CodeGat commented Jun 7, 2024 • edited Loading

github-actions bot commented Jun 7, 2024

github-actions bot commented Jun 11, 2024

CodeGat commented Jun 26, 2024

`ACCESS-OM2` Dependencies Update #60

`ACCESS-OM2` Dependencies Update #60

CodeGat commented Apr 26, 2024 •

edited by aidanheerdegen

Loading

github-actions bot commented Apr 26, 2024 •

edited by CodeGat

Loading

aidanheerdegen commented Jun 6, 2024 •

edited

Loading

CodeGat commented Jun 6, 2024 •

edited

Loading

CodeGat commented Jun 7, 2024 •

edited

Loading