bump to python3.11 #461

scottyhq · 2023-06-09T05:38:31Z

Updates all images from Python 3.10 -> Python 3.11

Generally I think it's good to keep these images in sync with the latest Python stable version and 3.12 is right around the corner! https://devguide.python.org/versions/

github-actions · 2023-06-09T05:38:40Z

👈 Try on Mybinder.org!
👈 Try on Pangeo GCP Binder!
👈 Try on Pangeo AWS Binder!

pangeo-bot · 2023-06-09T05:38:42Z

/condalock
Automatically locking new conda environment, building, and testing images...

weiji14 · 2023-06-10T02:30:55Z

Couple of things:

Could also try bumping to Python 3.11 at

pangeo-docker-images/environment-condalock.yml

Line 5 in 9375b20

- python=3.10
Running conda-lock on pangeo-notebook failed with a super long error message at https://github.com/pangeo-data/pangeo-docker-images/actions/runs/5218659799/jobs/9419649873. The last 'few' lines though are like this:

├─ earthdata   is uninstallable because there are no viable options
│  ├─ earthdata 0.1.1a6 would require
│  │  └─ s3fs >=2021.8.1,<2022.0.0  but there are no viable options
│  │     ├─ s3fs [2021.10.0|2021.10.1|2021.8.1|2021.9.0] would require
│  │     │  └─ aiobotocore [1.4.0 |1.4.1 ], which requires
│  │     │     └─ botocore >=1.20.106,<1.20.107 , which conflicts with any installable versions previously reported;
│  │     ├─ s3fs 2021.11.0 would require
│  │     │  ├─ aiobotocore 1.4.1 , which cannot be installed (as previously explained);
│  │     │  └─ fsspec 2021.11.0 , which can be installed;
│  │     └─ s3fs 2021.11.1 would require
│  │        ├─ aiobotocore 2.0.1 , which requires
│  │        │  └─ botocore >=1.22.8,<1.22.9 , which conflicts with any installable versions previously reported;
│  │        └─ fsspec 2021.11.1 , which can be installed;
│  ├─ earthdata [0.2.0|0.2.1|0.2.2|0.3.1] would require
│  │  └─ s3fs >=2021.8.1,<2023.0.0  but there are no viable options
│  │     ├─ s3fs [2021.10.0|2021.10.1|2021.8.1|2021.9.0], which cannot be installed (as previously explained);
│  │     ├─ s3fs 2021.11.0, which cannot be installed (as previously explained);
│  │     ├─ s3fs 2021.11.1, which cannot be installed (as previously explained);
│  │     ├─ s3fs 2022.1.0 would require
│  │     │  ├─ aiobotocore 2.1.0 , which requires
│  │     │  │  └─ botocore >=1.23.24,<1.23.25 , which conflicts with any installable versions previously reported;
│  │     │  └─ fsspec 2022.1.0 , which conflicts with any installable versions previously reported;
│  │     ├─ s3fs 2022.10.0 would require
│  │     │  ├─ aiobotocore >=2.4.0,<2.4.1 , which requires
│  │     │  │  └─ botocore >=1.27.59,<1.27.60 , which conflicts with any installable versions previously reported;
│  │     │  └─ fsspec 2022.10.0 , which conflicts with any installable versions previously reported;
│  │     ├─ s3fs 2022.11.0 would require
│  │     │  ├─ aiobotocore >=2.4.0,<2.4.1 , which cannot be installed (as previously explained);
│  │     │  └─ fsspec 2022.11.0 , which conflicts with any installable versions previously reported;
│  │     ├─ s3fs 2022.2.0 would require
│  │     │  ├─ aiobotocore [2.1.0 |>=2.1.0,<2.2 ], which cannot be installed (as previously explained);
│  │     │  └─ fsspec 2022.2.0 , which conflicts with any installable versions previously reported;
│  │     ├─ s3fs 2022.3.0 would require
│  │     │  ├─ aiobotocore >=2.2.0,<2.3 , which requires
│  │     │  │  └─ botocore >=1.24.21,<1.24.22 , which conflicts with any installable versions previously reported;
│  │     │  └─ fsspec 2022.3.0 , which conflicts with any installable versions previously reported;
│  │     ├─ s3fs 2022.5.0 would require
│  │     │  ├─ aiobotocore >=2.3.0,<2.4 , which cannot be installed (as previously explained);
│  │     │  └─ fsspec 2022.5.0 , which conflicts with any installable versions previously reported;
│  │     ├─ s3fs 2022.7.1 would require
│  │     │  ├─ aiobotocore >=2.3.4,<2.4 , which cannot be installed (as previously explained);
│  │     │  └─ fsspec 2022.7.1 , which conflicts with any installable versions previously reported;
│  │     └─ s3fs 2022.8.2 would require
│  │        ├─ aiobotocore >=2.4.0,<2.4.1 , which cannot be installed (as previously explained);
│  │        └─ fsspec 2022.8.2 , which conflicts with any installable versions previously reported;
│  └─ earthdata [0.4.0|0.4.1] would require
│     ├─ fsspec >=2022.1 , which conflicts with any installable versions previously reported;
│     ├─ python-benedict >=0.25 , which requires
│     │  └─ pyyaml >=6.0,<7.0  with the potential options
│     │     ├─ pyyaml [5.4.1|6.0], which can be installed (as previously explained);
│     │     ├─ pyyaml 6.0 conflicts with any installable versions previously reported;
│     │     ├─ pyyaml [5.3|5.3.1|5.4.1|6.0], which can be installed (as previously explained);
│     │     ├─ pyyaml [5.3.1|5.4.1|6.0], which can be installed (as previously explained);
│     │     ├─ pyyaml [5.3|5.3.1|5.4.1|6.0], which can be installed (as previously explained);
│     │     ├─ pyyaml [5.4.1|6.0], which cannot be installed (as previously explained);
│     │     ├─ pyyaml [5.3.1|5.4.1|6.0], which can be installed (as previously explained);
│     │     └─ pyyaml [5.4.1|6.0], which cannot be installed (as previously explained);
│     └─ s3fs >=2021.11,<2024  but there are no viable options
│        ├─ s3fs 2021.11.0, which cannot be installed (as previously explained);
│        ├─ s3fs 2021.11.1, which cannot be installed (as previously explained);
│        ├─ s3fs 2022.1.0, which cannot be installed (as previously explained);
│        ├─ s3fs 2022.10.0, which cannot be installed (as previously explained);
│        ├─ s3fs 2022.11.0, which cannot be installed (as previously explained);
│        ├─ s3fs 2022.2.0, which cannot be installed (as previously explained);
│        ├─ s3fs 2022.3.0, which cannot be installed (as previously explained);
│        ├─ s3fs 2022.5.0, which cannot be installed (as previously explained);
│        ├─ s3fs 2022.7.1, which cannot be installed (as previously explained);
│        ├─ s3fs 2022.8.2, which cannot be installed (as previously explained);
│        ├─ s3fs 2023.1.0 would require
│        │  ├─ aiobotocore >=2.4.2,<2.4.3 , which cannot be installed (as previously explained);
│        │  └─ fsspec 2023.1.0 , which conflicts with any installable versions previously reported;
│        ├─ s3fs 2023.3.0 would require
│        │  ├─ aiobotocore >=2.4.2,<2.4.3 , which cannot be installed (as previously explained);
│        │  └─ fsspec 2023.3.0 , which conflicts with any installable versions previously reported;
│        └─ s3fs [2023.4.0|2023.5.0] would require
│           └─ aiobotocore >=2.5.0,<2.5.1 , which requires
│              └─ botocore >=1.29.76,<1.29.77 , which conflicts with any installable versions previously reported;
├─ pangeo-notebook 2023.05.30**  is installable and it requires
│  └─ pangeo-dask 2023.05.30.* , which requires
│     └─ dask 2023.5.1.* , which requires
│        └─ lz4 >=4.3.2  with the potential options
│           ├─ lz4 4.3.2 would require
│           │  └─ python_abi 3.10.* *_cp310 with the potential options
│           │     ├─ python_abi 3.10, which can be installed;
│           │     └─ python_abi 3.10, which cannot be installed (as previously explained);
│           ├─ lz4 4.3.2 would require
│           │  └─ python_abi 3.11.* *_cp311, which can be installed;
│           ├─ lz4 4.3.2 would require
│           │  └─ python_abi 3.8.* *_cp38 with the potential options
│           │     ├─ python_abi 3.8, which can be installed;
│           │     └─ python_abi 3.8, which cannot be installed (as previously explained);
│           ├─ lz4 4.3.2 would require
│           │  └─ python_abi 3.8 *_pypy38_pp73, which cannot be installed (as previously explained);
│           ├─ lz4 4.3.2 would require
│           │  └─ python_abi 3.9.* *_cp39 with the potential options
│           │     ├─ python_abi 3.9, which can be installed;
│           │     └─ python_abi 3.9, which cannot be installed (as previously explained);
│           └─ lz4 4.3.2 would require
│              └─ python_abi 3.9 *_pypy39_pp73, which cannot be installed (as previously explained);
├─ python 3.11** , which cannot be installed (as previously explained);
└─ xcape   is installable with the potential options
   ├─ xcape [0.1|0.1.1|0.1.2|0.1.3|0.1.4] would require
   │  └─ python_abi 3.6.* *_cp36m, which can be installed;
   ├─ xcape [0.1|0.1.1|0.1.2|0.1.3|0.1.4] would require
   │  └─ python_abi 3.7.* *_cp37m with the potential options
   │     ├─ python_abi 3.7, which can be installed;
   │     └─ python_abi 3.7, which cannot be installed (as previously explained);
   ├─ xcape [0.1.1|0.1.2|0.1.3|0.1.4] would require
   │  └─ python_abi 3.8.* *_cp38 with the potential options
   │     ├─ python_abi 3.8, which can be installed;
   │     └─ python_abi 3.8, which cannot be installed (as previously explained);
   ├─ xcape [0.1.2|0.1.3|0.1.4] would require
   │  └─ python_abi 3.9.* *_cp39 with the potential options
   │     ├─ python_abi 3.9, which can be installed;
   │     └─ python_abi 3.9, which cannot be installed (as previously explained);
   ├─ xcape 0.1.4 would require
   │  └─ python_abi 3.10.* *_cp310 with the potential options
   │     ├─ python_abi 3.10, which can be installed;
   │     └─ python_abi 3.10, which cannot be installed (as previously explained);
   ├─ xcape 0.1.4 would require
   │  └─ python_abi 3.11.* *_cp311, which can be installed;
   ├─ xcape 0.1.4 would require
   │  └─ python_abi 3.8 *_pypy38_pp73, which cannot be installed (as previously explained);
   └─ xcape 0.1.4 would require
      └─ python_abi 3.9 *_pypy39_pp73, which cannot be installed (as previously explained).

Thinking that renaming earthdata to earthaccess might help a bit, see PR at #463.

scottyhq · 2023-06-12T15:47:26Z

/condalock

scottyhq · 2023-06-12T16:06:29Z

For forge image looks like apache-beam-with-gcp>=2.47 is needed

pangeo-docker-images/forge/environment.yml

Line 12 in 9375b20

- apache-beam-with-gcp=2.43.0

apache-beam-with-gcp          2.45.0  py39hf3d152e_0  conda-forge 
apache-beam-with-gcp          2.46.0 py310hff52083_0  conda-forge         
apache-beam-with-gcp          2.46.0  py38h578d9bd_0  conda-forge         
apache-beam-with-gcp          2.46.0  py39hf3d152e_0  conda-forge         
apache-beam-with-gcp          2.47.0 py310hff52083_0  conda-forge         
apache-beam-with-gcp          2.47.0 py311h38be061_0  conda-forge         
apache-beam-with-gcp          2.47.0  py38h578d9bd_0  conda-forge         
apache-beam-with-gcp          2.47.0  py39hf3d152e_0  conda-forge         
apache-beam-with-gcp          2.48.0 py310hff52083_0  conda-forge         
apache-beam-with-gcp          2.48.0 py311h38be061_0  conda-forge

scottyhq · 2023-06-12T17:18:47Z

For ml-notebook waiting on tensorflow>=2.12 which supports python 3.11 conda-forge/tensorflow-feedstock#316

weiji14 · 2023-07-03T02:04:32Z

For forge image looks like apache-beam-with-gcp>=2.47 is needed

Started PR to pin to apache-beam-with-gcp at #470. Edit: done ✔️

For ml-notebook waiting on tensorflow>=2.12 which supports python 3.11 conda-forge/tensorflow-feedstock#316

New effort going on at conda-forge/tensorflow-feedstock#323.

ngam · 2023-07-03T12:41:36Z

I’d be wary of this because of dask fwiw

scottyhq · 2023-07-27T00:57:38Z

/condalock

weiji14 · 2023-09-14T02:07:47Z

/condalock

pangeo-notebook/packages.txt

weiji14 · 2023-09-14T21:07:24Z

/condalock

weiji14 · 2023-09-14T22:56:32Z

/condalock

weiji14 · 2023-09-14T23:04:40Z

/condalock

scottyhq · 2023-09-15T18:43:49Z

/condalock

pangeo-notebook/environment.yml

scottyhq · 2023-09-18T17:14:58Z

/condalock

weiji14

Wish the diff could be smaller, but looks good to me! Thanks @scottyhq for seeing this through. Will leave it up to you on whether to merge this before or after conda-forge/argopy-feedstock#15 is done.

scottyhq · 2023-09-19T16:50:12Z

/condalock

bump to python3.11

c00fad1

scottyhq marked this pull request as draft June 9, 2023 05:51

rename earthdata, wipe conda-lock

aca3f47

scottyhq mentioned this pull request Jun 21, 2023

Rename earthdata to earthaccess #463

Merged

weiji14 mentioned this pull request Jul 3, 2023

Bump apache-beam-with-gcp from 2.43.0 to 2.48.0 #470

Merged

scottyhq added 2 commits July 26, 2023 17:56

merge master

10324e7

keep awscli for now

6d99ae5

Merge branch 'master' into python311

a254858

[condalock-command] autogenerated conda-lock files

f25692b

scottyhq marked this pull request as ready for review September 14, 2023 18:06

scottyhq commented Sep 14, 2023

View reviewed changes

pangeo-notebook/packages.txt Outdated Show resolved Hide resolved

scottyhq commented Sep 14, 2023

View reviewed changes

pangeo-notebook/packages.txt Show resolved Hide resolved

[condalock-command] autogenerated conda-lock files

80215c6

weiji14 mentioned this pull request Sep 14, 2023

Bump conda-lock from 1.4 to 2.3 #483

Merged

Merge branch 'master' into python311

2f06e84

Manually refresh conda-lock.yml files

775ca92

[condalock-command] autogenerated conda-lock files

ffee6d4

scottyhq mentioned this pull request Sep 15, 2023

Recipe requirements out of sync with requirements.txt conda-forge/argopy-feedstock#15

Closed

1 task

purge old libs, argopy to pip

4f7c450

[condalock-command] autogenerated conda-lock files

c47ded3

scottyhq commented Sep 15, 2023

View reviewed changes

pangeo-notebook/environment.yml Outdated Show resolved Hide resolved

scottyhq requested a review from weiji14 September 15, 2023 18:52

scottyhq added 2 commits September 18, 2023 10:14

reinstate jupyterlab-git

9172bae

Merge branch 'master' into python311

27bcf15

[condalock-command] autogenerated conda-lock files

680cabd

weiji14 approved these changes Sep 18, 2023

View reviewed changes

argopy from condaforge

2d7d16a

[condalock-command] autogenerated conda-lock files

7ae62ac

scottyhq merged commit a736179 into master Sep 19, 2023

scottyhq deleted the python311 branch September 19, 2023 17:23

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

bump to python3.11 #461

bump to python3.11 #461

scottyhq commented Jun 9, 2023 •

edited

Loading

github-actions bot commented Jun 9, 2023

pangeo-bot commented Jun 9, 2023

weiji14 commented Jun 10, 2023 •

edited

Loading

scottyhq commented Jun 12, 2023

scottyhq commented Jun 12, 2023 •

edited

Loading

scottyhq commented Jun 12, 2023

weiji14 commented Jul 3, 2023 •

edited

Loading

ngam commented Jul 3, 2023

scottyhq commented Jul 27, 2023

weiji14 commented Sep 14, 2023

weiji14 commented Sep 14, 2023

weiji14 commented Sep 14, 2023

weiji14 commented Sep 14, 2023

scottyhq commented Sep 15, 2023

scottyhq commented Sep 18, 2023

weiji14 left a comment

scottyhq commented Sep 19, 2023

bump to python3.11 #461

bump to python3.11 #461

Conversation

scottyhq commented Jun 9, 2023 • edited Loading

github-actions bot commented Jun 9, 2023

pangeo-bot commented Jun 9, 2023

weiji14 commented Jun 10, 2023 • edited Loading

scottyhq commented Jun 12, 2023

scottyhq commented Jun 12, 2023 • edited Loading

scottyhq commented Jun 12, 2023

weiji14 commented Jul 3, 2023 • edited Loading

ngam commented Jul 3, 2023

scottyhq commented Jul 27, 2023

weiji14 commented Sep 14, 2023

weiji14 commented Sep 14, 2023

weiji14 commented Sep 14, 2023

weiji14 commented Sep 14, 2023

scottyhq commented Sep 15, 2023

scottyhq commented Sep 18, 2023

weiji14 left a comment

Choose a reason for hiding this comment

scottyhq commented Sep 19, 2023

scottyhq commented Jun 9, 2023 •

edited

Loading

weiji14 commented Jun 10, 2023 •

edited

Loading

scottyhq commented Jun 12, 2023 •

edited

Loading

weiji14 commented Jul 3, 2023 •

edited

Loading