Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Model Freezing ❄️ #10

Open
icedoom888 opened this issue Dec 2, 2024 · 3 comments · May be fixed by ecmwf/anemoi-training#189
Open

[Feature] Model Freezing ❄️ #10

icedoom888 opened this issue Dec 2, 2024 · 3 comments · May be fixed by ecmwf/anemoi-training#189
Assignees
Labels
enhancement New feature or request training

Comments

@icedoom888
Copy link
Contributor

Is your feature request related to a problem? Please describe.

How can we train only a part of your model?

Describe the solution you'd like

Parameter freezing: specify in the config, which part of th emodel are meant to be trained.
Only add to the optimiser's trainable parameters the list of parameters to train over.

Describe alternatives you've considered

No response

Additional context

No response

Organisation

MeteoSwiss

@icedoom888 icedoom888 added the enhancement New feature or request label Dec 2, 2024
@icedoom888 icedoom888 self-assigned this Dec 2, 2024
@icedoom888 icedoom888 changed the title [Feature] Model Freezing [Feature] Model Freezing ❄️ Dec 2, 2024
@mchantry
Copy link
Member

mchantry commented Dec 2, 2024

@JesperDramsch has started to look into this @icedoom888

@icedoom888
Copy link
Contributor Author

Hey @mchantry, I didn't see any issue or feature request in any repo/taskboard.
Do you want to collab on this @JesperDramsch?

@icedoom888
Copy link
Contributor Author

icedoom888 commented Dec 6, 2024

Done, implemented and tested ✔ waiting on ecmwf/anemoi-training#166 to be merged first!

@icedoom888 icedoom888 linked a pull request Dec 6, 2024 that will close this issue
@JesperDramsch JesperDramsch transferred this issue from ecmwf/anemoi-training Dec 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request training
Projects
None yet
Development

Successfully merging a pull request may close this issue.

3 participants