Skip to content

[Dygraph] Support sharding stage2/3+dp in GPT-3 model#2471

Merged
gongel merged 6 commits intoPaddlePaddle:developfrom haohongxiang:support_sharding_dpSep 29, 2022