[Unified checkpoint] Support sharding_comm_overlap #9391
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
* update async save signal * fix async save hang
…addleNLP into origin_release_3.0-beta2
* bug fix * bug fix
…addleNLP into origin_release_3.0-beta2
…addlePaddle#9034) * [Unified Checkpoint] speed up loading checkpoint by multi thread * [Unified CHeckpoint] speed up load by multi-thread * [Unified CHeckpoint] speed up load by multi-thread * [Unified CHeckpoint] speed up load by multi-thread * Unified CHeckpoint] speed up loading checkpoint by multi-thread * Unified CHeckpoint] speed up loading checkpoint by multi-thread * Unified CHeckpoint] speed up loading checkpoint by multi-thread * Unified CHeckpoint] speed up loading checkpoint by multi-thread * Unified CHeckpoint] speed up loading checkpoint by multi-thread * Unified CHeckpoint] speed up loading checkpoint by multi-thread
…addleNLP into origin_release_3.0-beta2
…addleNLP into origin_release_3.0-beta2
…9240) * [Unified checkpoint] update optimizer async save signal * update paddlepaddle * split param * add save for split param * fix save split_param * add load uc split_param * update uc files * update uc files * update split_param loading * mkdir unified_checkpoint directory * rename file * update async handler * update files --------- Co-authored-by: gongenlei <gongenlei@baidu.com>
…save_info.json location (PaddlePaddle#9321) * [Unified checkpoint] update optimizer async save signal * update async_save_info.json file place
…addleNLP into origin_release_3.0-beta2
* fix empty state_dict * update sharding split_parma
…addleNLP into origin_release_3.0-beta2
|
Thanks for your contribution! |
DesmonDay
force-pushed
the
origin_release_3.0-beta2
branch
from
01e491d to
5e67a54
Compare
Codecov ReportAttention: Patch coverage is
Additional details and impacted files@@ Coverage Diff @@
## release/3.0-beta2 #9391 +/- ##
=====================================================
- Coverage 52.74% 52.73% -0.01%
=====================================================
Files 666 666
Lines 107023 107032 +9
=====================================================
+ Hits 56446 56447 +1
- Misses 50577 50585 +8 ☔ View full report in Codecov by Sentry. |
lugimzzz
force-pushed
the
origin_release_3.0-beta2
branch
from
5e67a54 to
37f4bc5
Compare
…addleNLP into origin_release_3.0-beta2
lugimzzz
force-pushed
the
origin_release_3.0-beta2
branch
from
37f4bc5 to
5a03c3b
Compare
DesmonDay
merged commit 5f4dd96
into
PaddlePaddle:release/3.0-beta2
3 of 5 checks passed
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR types
Function optimization
PR changes
Others
Description
Support sharding_comm_overlap