update hygon dcu docs #9298
update hygon dcu docs #9298
Conversation
llm/dcu/llama/README.md
Outdated
| ``` | ||
| # 安装paddlenlp | ||
| # 第一种方式安装 | ||
| pip3 install --upgrade paddlenlp==3.0.0b0 http://mirrors.aliyun.com/pypi/simple/ |
llm/dcu/llama/README.md
Outdated
| (3). 安装paddle | ||
| ``` | ||
| # paddlepaddle『飞桨』深度学习框架，提供运算基础能力 | ||
| python -m pip install paddlepaddle-dcu==3.0.0b1 -i https://www.paddlepaddle.org.cn/packages/stable/dcu/ |
There was a problem hiding this comment.
马上发布3.0.0b2版本，是否需要安装最新版本。当前版本安装驱动官网展示是23，是否符合镜像驱动？
There was a problem hiding this comment.
请问基于dtk23编译的paddle包是哪里提供的呢，目前我们都是基于dtk24的环境使用paddle包了
There was a problem hiding this comment.
不过也没关系，dtk23上编译的包，在dtk24环境上也可以正常使用
llm/dcu/llama/README.md
Outdated
| ## 3.预训练： | ||
| ### 权重链接 | ||
|
|
||
| 13B:[https://huggingface.co/meta-llama/Llama-2-7b](https://huggingface.co/meta-llama/Llama-2-7b) |
There was a problem hiding this comment.
权重不需要重新下载，PaddleNLP from_pretrained时会自动下载
llm/dcu/llama/run_pretrain.sh
Outdated
| rm -rf "output/$task_name""_log" | ||
|
|
||
| PYTHONPATH=..:$PYTHONPATH \ | ||
| python -m paddle.distributed.launch \ |
There was a problem hiding this comment.
可以参考PaddleNLP/llm下的运行方式，当前支持config.json和命令行结合的方式（命令行优先），无需添加这个运行脚本
There was a problem hiding this comment.
是将运行方式改为
python -u -m paddle.distributed.launch --gpus "0,1,2,3,4,5,6,7" run_pretrain.py config/llama/dcu_pretrain.json
这种形式吗
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## develop #9298 +/- ##
===========================================
+ Coverage 52.78% 52.91% +0.13%
===========================================
Files 661 661
Lines 106945 106945
===========================================
+ Hits 56448 56595 +147
+ Misses 50497 50350 -147 ☔ View full report in Codecov by Sentry. |
|
Thanks for your contribution! |
* update hygon dcu docs
PR types
New features
PR changes
Docs
Description
更新了海光DCU产品运行llama模型的说明文档与脚本。