Skip to content

Commit

Permalink
[AutoParallel] update loss for global clip (#8750)
Browse files Browse the repository at this point in the history
* update loss for global clip

* skip ci
  • Loading branch information
JZ-LIANG authored Jul 12, 2024
1 parent 10d058d commit 7a1c439
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions scripts/distribute/ci_case_auto.sh
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ function llama_case_list_auto() {
llama_dygraph_auto_bs8_fp32_DP2
llama_dygraph_auto_bs8_fp32_DP2-MP2
llama_dygraph_auto_bs8_fp32_DP2-MP2-PP2
llama_dygraph_auto_bs8_fp16_DP2-MP2-PP2
# llama_dygraph_auto_bs8_fp16_DP2-MP2-PP2 TODO: REOPEN this PR when global clip merge in paddle dev.
llama_dy2st_auto_bs4_bf16_DP1-MP1-PP4-SD2-VPP3_split_bw
llama_dy2st_auto_bs4_bf16_DP1-MP1-PP4-SD2

Expand Down Expand Up @@ -760,7 +760,7 @@ function llama_dygraph_auto_bs8_fp16_DP2-MP2-PP2() {
ips=-1
mem=-1
echo "result: loss=$loss ips=$ips mem=$mem"
loss_base=9.41604424
loss_base=9.41603851
if [ $IS_A100 -ne 0 ];then
loss_base=9.46169376
fi
Expand Down

0 comments on commit 7a1c439

Please sign in to comment.