Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

micromamba list runs indefinitely on Micromamba v2.0.0 #225

Closed
mrvisscher opened this issue Sep 26, 2024 · 30 comments · Fixed by mamba-org/mamba#3490
Closed

micromamba list runs indefinitely on Micromamba v2.0.0 #225

mrvisscher opened this issue Sep 26, 2024 · 30 comments · Fixed by mamba-org/mamba#3490
Labels
bug Something isn't working

Comments

@mrvisscher
Copy link

Our Github runners timed out last night running micromamba list. Fix for us right now is pinning the last Micromamba release before v2.0.0 but something is definitely up. Runner logs

@pavelzw
Copy link
Member

pavelzw commented Sep 26, 2024

i think this is an issue for the mamba repository, right @jjerphan @JohanMabille?
could you transfer it?

@mikemhenry
Copy link
Contributor

Related to mamba-org/micromamba-releases#58 probably, see if explicitly pulling in 2.0 fixes it

      - name: Setup micromamba
        uses: mamba-org/setup-micromamba@v1.9.0
        with:
          micromamba-version: '2.0.0-0'

@bhperry
Copy link
Contributor

bhperry commented Sep 26, 2024

pinning 2.0.0-0 did not fix for me. It seems like it's always using the same micromamba version no matter what I pin.

I see this in the logs Will use pre-installed micromamba at /home/runner/micromamba-bin/micromamba

How do I get it to not use the pre-installed version?

@bhperry
Copy link
Contributor

bhperry commented Sep 26, 2024

Looks like there is a pre-installed version on the runner, and setup-micromamba will completely ignore your pinned version if that exists.

Also had to got through and delete all of the github actions caches for micromamba because otherwise even with the correct binary, it would still fail to list when pulling the previous cache.

@bhperry
Copy link
Contributor

bhperry commented Sep 26, 2024

This is what fixed it for me

      - name: Set up micromamba
        uses: mamba-org/setup-micromamba@v1.9.0
        with:
          # https://github.com/mamba-org/setup-micromamba/issues/225
          micromamba-version: 1.5.10-0
          micromamba-binary-path: /home/runner/micromamba-bin-versioned/micromamba

And then delete every previous micromamba cache from github actions cache

fabcor-maxiv added a commit to fabcor-maxiv/mxcubeweb that referenced this issue Sep 27, 2024
Pin version of micromamba to `1.5.10-0` in GitHub Actions workflows
because of following issue:
mamba-org/setup-micromamba#225

GitHub: fix mxcube#1424
fabcor-maxiv added a commit to fabcor-maxiv/mxcubeweb that referenced this issue Sep 27, 2024
Pin version of micromamba to `1.5.10-0` in GitHub Actions workflows
because of following issue:
mamba-org/setup-micromamba#225

GitHub: fix mxcube#1424
marcus-oscarsson pushed a commit to mxcube/mxcubeweb that referenced this issue Sep 27, 2024
Pin version of micromamba to `1.5.10-0` in GitHub Actions workflows
because of following issue:
mamba-org/setup-micromamba#225

GitHub: fix #1424
@jjerphan
Copy link
Member

jjerphan commented Sep 30, 2024

I have not been able to reproduce the error yet, can you open an issue upstream with a specification of your environment? Thank you a lot.

@maresb
Copy link
Contributor

maresb commented Sep 30, 2024

@jjerphan, please find a minimal example in https://github.com/maresb/setup-micromamba-gh225

@jjerphan
Copy link
Member

I still cannot reproduce the error with micromamba 2.0.0.

@maresb
Copy link
Contributor

maresb commented Sep 30, 2024

@jjerphan are you trying to reproduce it locally or on GHA? If GHA then is my example deficient in any way to reproduce?

@jjerphan
Copy link
Member

We observe errors with GHA, as if it picks release candidates builds instead of the actual release builds.

@pavelzw
Copy link
Member

pavelzw commented Sep 30, 2024

are you sure it uses rcs? it should just use the latest version from micromamba-releases

@jjerphan
Copy link
Member

The latest build are not the actual latest one (we do not understand why).

@pavelzw
Copy link
Member

pavelzw commented Sep 30, 2024

are you sure?

❯ curl -Ls https://github.com/mamba-org/micromamba-releases/releases/latest/download/micromamba-linux-64 | sha256sum
b1b8b7a445b5bac0d7417c45f2eb3a29280567975d0185e7d9f4c5a94e2ef784  -
~
❯ curl -Ls https://github.com/mamba-org/micromamba-releases/releases/download/2.0.0-1/micromamba-linux-64 | sha256sum
b1b8b7a445b5bac0d7417c45f2eb3a29280567975d0185e7d9f4c5a94e2ef784  -
~
❯ curl -Ls https://github.com/mamba-org/micromamba-releases/releases/download/2.0.0rc6-0/micromamba-linux-64 | sha256sum
34354f0feebbb450905fc0fe55d4227c2c7a69eab3587a5b905d1d1dfc2d3ca7  -

this looks fine to me 🤔

or is the 2.0.0-1 release already faulty?

@jjerphan
Copy link
Member

We have had observed problem with the "latest" builds when the version of micromamba was not explicitly specified (hence our recommendation to pin 2.0.0-0).

Zeitsperre added a commit to hydrologie/xdatasets that referenced this issue Oct 1, 2024
### What kind of change does this PR introduce?

* Pins the micromamba binary version

### Does this PR introduce a breaking change?

No.

### Other information:

mamba-org/setup-micromamba#225
Zeitsperre added a commit to hydrologie/xhydro that referenced this issue Oct 1, 2024
### What kind of change does this PR introduce?

* Pins the micromamba binary version.

### Does this PR introduce a breaking change?

No.

### Other information:

mamba-org/setup-micromamba#225
orbeckst added a commit to Becksteinlab/GromacsWrapper that referenced this issue Oct 1, 2024
- fix #298 (temporarily)
- see mamba-org/setup-micromamba#225 for details
@orbeckst
Copy link

orbeckst commented Oct 1, 2024

micromamba-version: 1.5.10-0 worked for me after deleting all GH caches.

@jjerphan
Copy link
Member

jjerphan commented Oct 2, 2024

I can reproduce the issue with 2.0.1 and the following environment:

name: repro
channels:
  - conda-forge
dependencies:
  - python=3.10
  - httpx>=0.25.0
  - pandas[version=">=0.25.2,<3"]
  - pytz
  - cartopy>=0.21
  - cartopy_offlinedata
  - check-manifest
  - geopandas
  - interrogate
  - joblib
  - jupyter
  - nbclassic
  - nbconvert
  - nbsphinx
  - netcdf4
  - pendulum>=2.0.1
  - pooch
  - pre-commit
  - pyarrow
  - pytest
  - pytest-cov
  - pytest-sugar
  - pytest-vcr
  - regionmask>=0.9
  - scitools-iris>=3.3.0
  - setuptools_scm
  - sphinx
  - twine
  - types-pytz
  - types-requests
  - wheel
  - xarray

from https://github.com/ioos/erddapy/actions/runs/11124942088/job/30911568849?pr=353.

@ricardoV94
Copy link

Does not seem to be specific to v2, also failed with v1 here for us: https://github.com/pymc-devs/pytensor/actions/runs/11141222416/job/30961688938?pr=1008

@pavelzw
Copy link
Member

pavelzw commented Oct 2, 2024

might be because of caching? #225 (comment)

ricardoV94 added a commit to ricardoV94/pytensor that referenced this issue Oct 2, 2024
@maresb
Copy link
Contributor

maresb commented Oct 2, 2024

Does not seem to be specific to v2, also failed with v1 here for us: https://github.com/pymc-devs/pytensor/actions/runs/11141222416/job/30961688938?pr=1008

False alarm, I just chatted with @ricardoV94, and he was referring to v1 of the setup-micromamba GHA rather than v2.0.1 of micromamba. So the problem is indeed related in his case to the v2 release of micromamba since he has micromamba-version: "latest".

@ricardoV94
Copy link

Thanks for clarifying. And to answer the other comment if still relevant I tried deleting the caches related to micromamba and that still hanged

ricardoV94 added a commit to ricardoV94/pytensor that referenced this issue Oct 2, 2024
ricardoV94 added a commit to ricardoV94/pytensor that referenced this issue Oct 2, 2024
ricardoV94 added a commit to ricardoV94/pytensor that referenced this issue Oct 2, 2024
ricardoV94 added a commit to pymc-devs/pytensor that referenced this issue Oct 2, 2024
@bhperry
Copy link
Contributor

bhperry commented Oct 2, 2024

Thanks for clarifying. And to answer the other comment if still relevant I tried deleting the caches related to micromamba and that still hanged

Try 1.5.10-0 from a clean cache

@ricardoV94
Copy link

Thanks for clarifying. And to answer the other comment if still relevant I tried deleting the caches related to micromamba and that still hanged

Try 1.5.10-0 from a clean cache

Yes that works

Zeitsperre added a commit to Ouranosinc/raven that referenced this issue Oct 3, 2024
## Overview

Changes:

* Pinned micromamba binary version

## Related Issue / Discussion

## Additional Information

mamba-org/setup-micromamba#225
Zeitsperre added a commit to Ouranosinc/raven-hydro that referenced this issue Oct 3, 2024
### What kind of change does this PR introduce?

* Pins the micromamba binary version

### Does this PR introduce a breaking change?

No.

### Other information:

mamba-org/setup-micromamba#225
@jmccreight
Copy link

@SylvainCorlay I dont understand why this issue is closed as completed. Is there a resolution? My understanding is that we have to effectively pin "1.5.10-0" and that dosent seem to be a solution going forward. But hopefully I missed something. Or is it because this is an issue external to setup-micromamba?
thanks!

@SylvainCorlay
Copy link
Member

Hi @jmccreight this should be resolved with micromamba 2.0.2. Are you still seeing this issue with the latest micromamba?

Ch0ronomato pushed a commit to Ch0ronomato/pytensor that referenced this issue Nov 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

10 participants