Multigpu: Fix gradient accumulation and learning rate aggregation#3583

Merged

alanakbik merged 3 commits intoflairNLP:masterfrom ZipRecruiter:jeffp.multi-gpu-fixes

Dec 19, 2024

+38-29

Commits on Dec 17, 2024

Commits on Dec 18, 2024

Fix deadlock in checkpoint plugin
jeffpicard
committed