Code

Fix fsdp checkpoint strategy#1734

Code

Merged

bcui19 merged 13 commits intomosaicml:devmosaicml/composer:devfrom bcui19:fix_FSDP_checkpoint_strategybcui19/composer:fix_FSDP_checkpoint_strategyCopy head branch name to clipboardNov 18, 2022

+3

Commits

Commits on Oct 7, 2022

• Adding in performance registration

  

  Brandon Cui

  authored and

  Brandon Cui

  committed
  399b73e

Commits on Oct 18, 2022

• Merging with upstream

  bcui19

  committed
  13e7369

Commits on Oct 31, 2022

• Merging with upstream

  bcui19

  committed
  1f070fe

Commits on Nov 15, 2022

• merging upstream

  bcui19

  committed
  51636bf

• clearing optimizer param groups before FSDP wrapping

  bcui19

  committed
  126467e

• fixing comments

  bcui19

  committed
  5532531

Commits on Nov 16, 2022

• Adding a conditional to ignore checkpointing FSDP and FlattenedWrappers

  bcui19

  committed
  f9a3c44

• merging

  bcui19

  committed
  52ab9e4

• removing print comments

  bcui19

  committed
  3262b5d

• Adding in print for my own sanity

  bcui19

  committed
  df792c9

• removing extraneous print statement

  bcui19

  committed
  0ba35d1

Commits on Nov 18, 2022

• removing duplicate code due to a merge

  bcui19

  committed
  bb41808

• Merge branch 'dev' into fix_FSDP_checkpoint_strategy

  bcui19

  authored
  b36c546