Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

【AutoParallelism】fix dataloader bug and add ci for static #8014

Merged
merged 11 commits into from
Mar 4, 2024
Merged

【AutoParallelism】fix dataloader bug and add ci for static #8014

Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
6a21aa9
fix dataloader bug and add ci for static
heavyrain-lzy Feb 23, 2024
68a7c46
change dy2st ci
heavyrain-lzy Feb 28, 2024
5bb8f4c
disable fused_rms_norm
heavyrain-lzy Feb 28, 2024
67e2c84
disable pir-executor
heavyrain-lzy Feb 28, 2024
deb1c09
add loss on V100
heavyrain-lzy Feb 28, 2024
94e6750
polish
heavyrain-lzy Feb 29, 2024
25cc53a
polish
heavyrain-lzy Feb 29, 2024
08c1f10
Merge remote-tracking branch 'upstream/develop' into fix_dataloader
heavyrain-lzy Feb 29, 2024
8b61590
Merge remote-tracking branch 'upstream/develop' into fix_dataloader
heavyrain-lzy Mar 1, 2024
423a251
delete dy2st ci
heavyrain-lzy Mar 4, 2024
123be7a
delete dy2st ci
heavyrain-lzy Mar 4, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 5 additions & 2 deletions paddlenlp/trainer/auto_trainer.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -92,9 +92,12 @@
def _get_mesh(pp_idx=0):
return self.global_mesh.get_mesh_with_dim("pp")[pp_idx]

# Note(lizhiyu): If the values returned by `DataLoader` don't have the format `[images, labels]`,
# error may occurs here.
meshes = []
for pp_idx in range(self.args.pipeline_parallel_degree):
meshes.append(_get_mesh(pp_idx))
meshes.append(_get_mesh(0))
if self.args.pipeline_parallel_degree > 1:
meshes.append(_get_mesh(self.args.pipeline_parallel_degree - 1))

Check warning on line 100 in paddlenlp/trainer/auto_trainer.py

View check run for this annotation

Codecov / codecov/patch

paddlenlp/trainer/auto_trainer.py#L98-L100 

Added lines #L98 - L100 were not covered by tests
return meshes

def _wrap_for_dist_loader(self, train_dataloader):
Expand Down
Loading