Skip to content

Commit

Permalink
[Typo] fix script and docs typo (#6879)
Browse files Browse the repository at this point in the history
  • Loading branch information
BeingGod authored Sep 5, 2023
1 parent 63f654b commit 5fe97bd
Show file tree
Hide file tree
Showing 7 changed files with 29 additions and 29 deletions.
2 changes: 1 addition & 1 deletion llm/ernie-3.5-se/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,7 +43,7 @@ mv ernie_openwebtext_100k_idx.npz ./data

使用下面脚本,即可启动 ernie-3.5-se-3b 的预训练,也可直接参考 run_trainer_stage2.sh。
```shell
task_name="ernie35_hybid"
task_name="ernie35_hybrid"
python -u -m paddle.distributed.launch \
--gpus "0,1,2,3,4,5,6,7" \
--log_dir "output/$task_name""_log" \
Expand Down
2 changes: 1 addition & 1 deletion llm/ernie-3.5-se/run_trainer_stage2.sh
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@
set -x
unset CUDA_VISIBLE_DEVICES

task_name="ernie35_hybid"
task_name="ernie35_hybrid"
# rm -rf output/$task_name/
# rm -rf "output/$task_name""_log"

Expand Down
4 changes: 2 additions & 2 deletions llm/gpt-3/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,7 +28,7 @@ mv gpt_en_dataset_300m_idx.npz ./data

使用下面脚本,即可在gpt2-medium-en的基础上,继续训练.
```shell
task_name="gpt3_hybid"
task_name="gpt3_hybrid"
export PYTHONPATH="../../PaddleNLP/"
export FLAGS_cudnn_deterministic=True
log_dir="log"
Expand Down Expand Up @@ -107,7 +107,7 @@ python -u -m paddle.distributed.launch \
### SFT

```shell
task_name="gpt3_hybid"
task_name="gpt3_hybrid"
export PYTHONPATH="../../PaddleNLP/"
export FLAGS_cudnn_deterministic=True
log_dir="log"
Expand Down
44 changes: 22 additions & 22 deletions llm/llama/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,27 +4,27 @@

**支持模型权重:**

| Model |
|----------------------------------|
| facebook/llama-7b |
| facebook/llama-13b |
| facebook/llama-30b |
| facebook/llama-65b |
| meta-llama/Llama-2-7b |
| meta-llama/Llama-2-7b-chat |
| meta-llama/Llama-2-13b |
| meta-llama/Llama-2-13b-chat |
| meta-llama/Llama-2-70b |
| meta-llama/Llama-2-70b-chat |
| ziqingyang/chinese-llama-7b |
| ziqingyang/chinese-llama-13b |
| ziqingyang/chinese-alpaca-7b |
| ziqingyang/chinese-alpaca-13b |
| idea-ccnl/ziya-llama-13b-v1 |
| linly-ai/chinese-llama-2-7b |
| baichuan-inc/Baichuan-7B |
| baichuan-inc/Baichuan-13B-Base |
| baichuan-inc/Baichuan-13B-Chat |
| Model |
| ------------------------------ |
| facebook/llama-7b |
| facebook/llama-13b |
| facebook/llama-30b |
| facebook/llama-65b |
| meta-llama/Llama-2-7b |
| meta-llama/Llama-2-7b-chat |
| meta-llama/Llama-2-13b |
| meta-llama/Llama-2-13b-chat |
| meta-llama/Llama-2-70b |
| meta-llama/Llama-2-70b-chat |
| ziqingyang/chinese-llama-7b |
| ziqingyang/chinese-llama-13b |
| ziqingyang/chinese-alpaca-7b |
| ziqingyang/chinese-alpaca-13b |
| idea-ccnl/ziya-llama-13b-v1 |
| linly-ai/chinese-llama-2-7b |
| baichuan-inc/Baichuan-7B |
| baichuan-inc/Baichuan-13B-Base |
| baichuan-inc/Baichuan-13B-Chat |


使用方法:
Expand Down Expand Up @@ -62,7 +62,7 @@ mv llama_openwebtext_100k_idx.npz ./data

使用下面脚本,即可在llama-7b的基础上,继续训练.
```shell
task_name_or_path="llama_hybid"
task_name_or_path="llama_hybrid"
python -u -m paddle.distributed.launch \
--gpus "0,1,2,3,4,5,6,7" \
--log_dir "output/$task_name_or_path""_log" \
Expand Down
2 changes: 1 addition & 1 deletion llm/llama/run_trainer.sh
Original file line number Diff line number Diff line change
Expand Up @@ -14,7 +14,7 @@

set -x
unset CUDA_VISIBLE_DEVICES
task_name="llama_hybid"
task_name="llama_hybrid"
rm -rf output/$task_name/
rm -rf "output/$task_name""_log"

Expand Down
2 changes: 1 addition & 1 deletion llm/llama/run_trainer_tp4pp2.sh
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@
set -x
unset CUDA_VISIBLE_DEVICES

task_name="llama_hybid"
task_name="llama_hybrid"
rm -rf output/$task_name/
rm -rf "output/$task_name""_log"

Expand Down
2 changes: 1 addition & 1 deletion model_zoo/gpt/scripts/run_trainer.sh
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@
set -x
unset CUDA_VISIBLE_DEVICES

task_name="gpt_hybid"
task_name="gpt_hybrid"
rm -rf output/$task_name/
rm -rf "output/$task_name""_log"

Expand Down

0 comments on commit 5fe97bd

Please sign in to comment.