Skip to content
Formatting

Fix expert grad scaling problem with ZeRO optimizer #14532

Sign in to view logs

Fix expert grad scaling problem with ZeRO optimizer

Fix expert grad scaling problem with ZeRO optimizer #14532

Re-run triggered September 20, 2024 19:59
@tohtanatohtana
#6546
wyooyw:fix_expert_weight_grad_with_zero
Status Success
Total duration 1m 24s
Artifacts –

formatting.yml

on: pull_request
unit-tests
1m 13s
unit-tests
Fit to window
Zoom out
Zoom in