This repository has been archived by the owner on Dec 20, 2024. It is now read-only.

Feature/transfer-learning #166

Merged

icedoom888 merged 40 commits into ecmwf:develop from MeteoSwiss:feature/transfer-learning

Dec 6, 2024

Contributor

icedoom888 commented Nov 26, 2024

WIP: Working on implementation of Transfer Learning.

icedoom888 added 10 commits

October 9, 2024 15:25


          Introduced resume flag and checkpoint loading for transfer learning, …

7e238e4

…removed metadata saving in checkpoints due to corruption error on big models, fixed logging to work in the transfer leanring setting


          Added len of dataset computed dynamically

08671d7


          debugging validation

e2bd868


          Merge branch 'develop' into feature/transfer-learning

557a9f0


          Small changes

544dddc


          Removed prints

a85619d


          Merge branch 'develop' into feature/transfer-learning

b87f795


          Not working

c8ce0b0


          small changes

135eac5


          Rebased on develop

3cebf18

FussyDuck commented Nov 26, 2024 •

edited

Loading

All committers have signed the CLA.

github-actions bot added the contributor label


          Imputer changes

db2a14f

icedoom888 closed this

icedoom888 reopened this

Contributor Author

icedoom888 commented Nov 26, 2024 •

edited

Loading

Still work in progress, solves #167

icedoom888 added 5 commits

November 26, 2024 15:01


          Added sanification of checkpoint, effective batch size, git pre commit

57f9026

gpc

039c16f

gpc

463c6a9


          Merge branch 'develop' into feature/transfer-learning

062f552

Merged


          rebased on develop

2f4dd65

HCookie marked this pull request as draft

November 26, 2024 17:22

mchantry reviewed

View reviewed changes

src/anemoi/training/config/model/graphtransformer.yaml Outdated Show resolved Hide resolved

mchantry reviewed

View reviewed changes

src/anemoi/training/train/train.py Outdated Show resolved Hide resolved

mchantry reviewed

View reviewed changes

src/anemoi/training/train/train.py Outdated Show resolved Hide resolved

mchantry reviewed

View reviewed changes

src/anemoi/training/utils/checkpoint.py Outdated Show resolved Hide resolved


          New implementation: do not store modified checkpoint, load it directl…

c6d7519

…y after changing it

icedoom888 changed the title ~~Feature/transfer-learning~~ Feature/transfer-learning solves #167

icedoom888 changed the title ~~Feature/transfer-learning solves #167~~ Feature/transfer-learning


          Added logging

bca0355

icedoom888 requested a review from mchantry

December 3, 2024 09:18

JesperDramsch reviewed

View reviewed changes

src/anemoi/training/data/dataset.py Outdated Show resolved Hide resolved

JesperDramsch reviewed

View reviewed changes

src/anemoi/training/train/train.py Outdated Show resolved Hide resolved

JesperDramsch previously requested changes

View reviewed changes

src/anemoi/training/utils/checkpoint.py Outdated Show resolved Hide resolved

JesperDramsch reviewed

View reviewed changes

src/anemoi/training/utils/checkpoint.py Outdated Show resolved Hide resolved

icedoom888 added 2 commits

December 3, 2024 13:13


          Addressed review: copy checkpoint before removing metadata file

1ac34d8


          Merge remote-tracking branch 'refs/remotes/origin/feature/transfer-le…

b7697a1

…arning' into feature/transfer-learning

icedoom888 requested a review from JesperDramsch

December 3, 2024 13:01

icedoom888 and others added 7 commits

December 3, 2024 14:24


          Merge branch 'develop' into feature/transfer-learning

22ddeab


          gpc passed

0d4fa51


          Removed logger in debugging mode


          removed dataset lenght due to checkpointing issues

c325a9e


          Reintroduced correct config on graphtansformer

4709d46


          gpc passed

b0023f9


          Merge branch 'develop' into feature/transfer-learning

17d02f7

icedoom888 marked this pull request as draft

December 5, 2024 12:58


          Removed patched for issue ecmwf#57, code expects patched checkpoint a…

6a8ac97

…lready

mchantry reviewed

View reviewed changes

src/anemoi/training/utils/checkpoint.py Outdated Show resolved Hide resolved

icedoom888 added 3 commits

December 5, 2024 17:02


          Merge branch 'develop' into feature/transfer-learning

4cd24bd


          Removed new path name for patched checkpoint (ignoring fully issue ec…

355cca1

…mwf#57) + removed fix for missing config


          Adapted changelog

b875ea0

icedoom888 marked this pull request as ready for review

December 5, 2024 16:14

icedoom888 requested a review from mchantry

December 6, 2024 08:38

icedoom888 mentioned this pull request

[Feature] Model Freezing ❄️ ecmwf/anemoi-core#10

Open


          Switched logging to info from debug

7d51c75

icedoom888 dismissed JesperDramsch’s stale review

December 6, 2024 09:24

Outdated code

gabrieloks approved these changes

View reviewed changes

Contributor

gabrieloks left a comment

Did some final tests and looks good to me!

src/anemoi/training/utils/checkpoint.py Outdated Show resolved Hide resolved

src/anemoi/training/utils/checkpoint.py Outdated Show resolved Hide resolved

src/anemoi/training/utils/checkpoint.py Outdated Show resolved Hide resolved

src/anemoi/training/train/train.py Outdated Show resolved Hide resolved

src/anemoi/training/utils/checkpoint.py Outdated Show resolved Hide resolved

src/anemoi/training/utils/checkpoint.py Outdated Show resolved Hide resolved

CHANGELOG.md Outdated Show resolved Hide resolved

icedoom888 merged commit 891405e into ecmwf:develop

16 checks passed

icedoom888 deleted the feature/transfer-learning branch

December 6, 2024 10:37

JPXKQX mentioned this pull request

Release 0.3.2 #187

Merged

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels