Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Mvpatel2000/dirty ckpting #2672

Merged
merged 25 commits into from
Oct 27, 2023
Merged

Mvpatel2000/dirty ckpting #2672

merged 25 commits into from
Oct 27, 2023

Conversation

b-chu
Copy link
Contributor

@b-chu b-chu commented Oct 27, 2023

What does this PR do?

What issue(s) does this change relate to?

Before submitting

  • Have you read the contributor guidelines?
  • Is this change a documentation change or typo fix? If so, skip the rest of this checklist.
  • Was this change discussed/approved in a GitHub issue first? It is much more likely to be merged if so.
  • Did you update any related docs and document your change?
  • Did you update any related tests and add any new tests related to your change? (see testing)
  • Did you run the tests locally to make sure they pass?
  • Did you run pre-commit on your change? (see the pre-commit section of prerequisites)

j316chuck and others added 24 commits October 9, 2023 14:59
@j316chuck
Remove apex test and clean up fsdp warnings (mosaicml#2616)
ec0bff7
@mvpatel2000
patch default (mosaicml#2628)
d745fcb
@aspfohl
Add logging for generate callbacks (mosaicml#2630)
c9dcd2f 
* Update generate.py

* add missing imports
@antoinebrl @mvpatel2000
Expose input_names and output_names when exporting to ONNX (mosaicml#…
0a8cf18 
…2601)

* Expose input_names and output_names when exporting to ONNX

* assert sample_input type for pyright

* fix mocks

---------

Co-authored-by: Mihir Patel <mihir.v.patel7@gmail.com>
@mvpatel2000 @j316chuck
Bump version to 0.16.4 (mosaicml#2627)
1c9d8d1 
* bump version

* filter warning

* remove slack failure

* composer

* ckdn

* commit change

* commit change

* commit change

* commit change

* rename

* revert

* cleanup

* move around tests

* log

* fix slack

* clean test

* composer

* rearrange

* remove logs

* skip

* remove log

---------

Co-authored-by: Chuck Tang <chuck@mosaicml.com>
@mvpatel2000
many logs
8879d26
@mvpatel2000
typos
a7fcb99
@mvpatel2000
logs
b29094c
@mvpatel2000
filter
68a64d5
@mvpatel2000
logs
f206f97
@mvpatel2000
fix logs
b318a3e
@mvpatel2000
monkeypatch sharded tensor
8332579
@b-chu
Add partial state dict functionality for FSDP (mosaicml#2637)
28cc4ca 
* Use pytorch chunking

commit-id:e4c9b78f

* Add partial state dict functionality for FSDP

commit-id:2a2cae33
@dependabot
Update monai requirement from <1.3,>=0.9.1 to >=0.9.1,<1.4 (mosaicml#…
22d84f4 
…2643)

Updates the requirements on [monai](https://github.com/Project-MONAI/MONAI) to permit the latest version.
- [Release notes](https://github.com/Project-MONAI/MONAI/releases)
- [Changelog](https://github.com/Project-MONAI/MONAI/blob/dev/CHANGELOG.md)
- [Commits](Project-MONAI/MONAI@0.9.1...1.3.0)

---
updated-dependencies:
- dependency-name: monai
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump pytest-codeblocks from 0.16.1 to 0.17.0 (mosaicml#2645)
00ad78d 
Bumps [pytest-codeblocks](https://github.com/nschloe/pytest-codeblocks) from 0.16.1 to 0.17.0.
- [Release notes](https://github.com/nschloe/pytest-codeblocks/releases)
- [Commits](nschloe/pytest-codeblocks@v0.16.1...v0.17.0)

---
updated-dependencies:
- dependency-name: pytest-codeblocks
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@mvpatel2000
remove flush on close (mosaicml#2646)
5dff730
@mvpatel2000
update latest (mosaicml#2650)
1caacc3
@mvpatel2000
HSDP Support (mosaicml#2648)
b7b55b3 
* add hsdp

* add tuple support

* mod wide

* update

* set default

* disable error validation

* hsdp

* gate import
@j316chuck @mvpatel2000
Log profile averages (mosaicml#2647)
c14b8d0 
Co-authored-by: Mihir Patel <mihir.v.patel7@gmail.com>
@mvpatel2000
bump
799aa34
@mvpatel2000
daily key (mosaicml#2655)
d5a5779
@j316chuck
Add automatic remote uploader downloader for composer profiler (mosai…
d534e0a 
…cml#2653)
@willgleich @mvpatel2000
Update the AWS_OFI_NCCL version and add in the MPI HWLOC install (mos…
174e238 
…aicml#2651)

* Update the AWS_OFI_NCCL version and add in the MPI HWLOC install

* Move the HWLOC down to the appropriate stage

* Move the HWLOC to the apt-get install

* Remove extra debug arg

---------

Co-authored-by: Mihir Patel <mihir.v.patel7@gmail.com>
@mvpatel2000
merge
80579ac
@b-chu b-chu requested review from a team as code owners October 27, 2023 16:49
@b-chu b-chu merged commit 07693c5 into mosaicml:mvpatel2000/dirty-ckpting Oct 27, 2023
7 of 25 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@b-chu @j316chuck @mvpatel2000 @aspfohl @antoinebrl @willgleich