Skip to content

Commit

Permalink
Update llm docs requirements (#8336)
Browse files Browse the repository at this point in the history
* Update llm docs

* Update requirements.txt

* try to fix
  • Loading branch information
w5688414 authored Apr 30, 2024
1 parent 1c781d8 commit 3aa92ce
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion llm/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ PaddleNLP将飞桨4D并行策略加入到Trainer API中, 用户只需修改Tra

此项目支持了LLaMA、GPT-3、BaiChuan、Qwen 等大模型的预训练。用户切换配置config文件,即可一键运行。

数据详细制作流程可参考[此处](https://paddlenlp.readthedocs.io/zh/latest/pretraining/dataset.html) : https://paddlenlp.readthedocs.io/zh/latest/pretraining/dataset.html
数据详细制作流程可参考[此处](https://paddlenlp.readthedocs.io/zh/latest/llm/pretraining/dataset.html) : https://paddlenlp.readthedocs.io/zh/latest/llm/pretraining/dataset.html

为了方便用户运行测试本模型,本项目提供了处理好的100k条doc的训练样本:
```shell
Expand Down
2 changes: 1 addition & 1 deletion requirements-dev.txt
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
paddleocr
pre-commit
pytest
pytest==8.1.1
parameterized
pytest-cov
regex
Expand Down
2 changes: 1 addition & 1 deletion requirements.txt
Original file line number Diff line number Diff line change
Expand Up @@ -20,7 +20,7 @@ uvicorn
typer
rich
safetensors
tool_helpers
tool_helpers ; platform_system == "Linux"
aistudio-sdk>=0.1.3
jinja2
regex

0 comments on commit 3aa92ce

Please sign in to comment.