Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[PaddleNLP 3.0] Update README #8681

Merged
merged 35 commits into from
Jul 12, 2024
Merged
Show file tree
Hide file tree
Changes from 2 commits
Commits
Show all changes
35 commits
Select commit Hold shift + click to select a range
ca9518c
update
DrownFish19 Jun 28, 2024
8d30c5d
Merge branch 'PaddlePaddle:develop' into dev_update_readme_3.0beta
DrownFish19 Jul 3, 2024
d307fbb
update readme
DrownFish19 Jul 3, 2024
7dfafba
update
DrownFish19 Jul 4, 2024
91886d6
update
DrownFish19 Jul 4, 2024
f5fe743
Merge branch 'PaddlePaddle:develop' into dev_update_readme_3.0beta
DrownFish19 Jul 5, 2024
392ed1f
update
DrownFish19 Jul 5, 2024
ecc0b1a
Merge branch 'dev_update_readme_3.0beta' of github.com:DrownFish19/Pa…
DrownFish19 Jul 5, 2024
99617ec
update
DrownFish19 Jul 5, 2024
7745c49
update
DrownFish19 Jul 5, 2024
774c45b
update
DrownFish19 Jul 5, 2024
7a46e6a
update
DrownFish19 Jul 5, 2024
c6d2104
update README(EN)
DrownFish19 Jul 8, 2024
6f5e235
correct broken links in readme
jzhang533 Jul 10, 2024
ae6c69d
Merge branch 'PaddlePaddle:develop' into dev_update_readme_3.0beta
DrownFish19 Jul 10, 2024
bacb006
add markdownlint
DrownFish19 Jul 10, 2024
dc88f8f
update
DrownFish19 Jul 10, 2024
7f68f68
add check_spaces
DrownFish19 Jul 10, 2024
b09c85e
update
DrownFish19 Jul 10, 2024
1924426
Merge remote-tracking branch 'paddlenlp-zhangjun/update-break-links-i…
DrownFish19 Jul 10, 2024
46a55c9
Merge branch 'PaddlePaddle:develop' into dev_update_readme_3.0beta
DrownFish19 Jul 10, 2024
f35db62
Merge branch 'develop' into dev_update_readme_3.0beta
DrownFish19 Jul 10, 2024
f9efc5d
update readme
DrownFish19 Jul 10, 2024
26a2563
Merge branch 'PaddlePaddle:develop' into dev_update_readme_3.0beta
DrownFish19 Jul 10, 2024
87db3a8
update readme
DrownFish19 Jul 10, 2024
7d0627c
update
DrownFish19 Jul 10, 2024
b4a5862
update
DrownFish19 Jul 10, 2024
68ac2b3
Merge branch 'dev_update_readme_3.0beta' of github.com:DrownFish19/Pa…
DrownFish19 Jul 10, 2024
d3d90a9
update readmes
DrownFish19 Jul 11, 2024
0869e22
Merge branch 'develop' into dev_update_readme_3.0beta
DrownFish19 Jul 11, 2024
0574f12
update
DrownFish19 Jul 11, 2024
f99f61b
update
DrownFish19 Jul 11, 2024
6ad298b
update llm doc index
DrownFish19 Jul 11, 2024
e00e1d1
update
DrownFish19 Jul 11, 2024
2e6b521
add rlhf docs
DrownFish19 Jul 11, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@

## News 📢

* **2024.06.27 [PaddleNLP v3.0 Beta](https://github.com/PaddlePaddle/PaddleNLP/releases/tag/v3.0.0)**:拥抱大模型,体验全升级。统一大模型工具链,实现国产计算芯片全流程接入;全面支持飞桨4D并行配置、高效精调策略、高效对齐算法、高性能推理等大模型产业级应用流程;自研极致收敛的RsLoRA+算法、自动扩缩容存储机制Unified Checkpoint和通用化支持FastFFN、FusedQKV助力大模型训推;主流模型持续支持更新,提供高效解决方案。
* **2024.06.27 [PaddleNLP v3.0 Beta](https://github.com/PaddlePaddle/PaddleNLP/releases/tag/v3.0.0-beta0)**:拥抱大模型,体验全升级。统一大模型工具链,实现国产计算芯片全流程接入;全面支持飞桨4D并行配置、高效精调策略、高效对齐算法、高性能推理等大模型产业级应用流程;自研极致收敛的RsLoRA+算法、自动扩缩容存储机制Unified Checkpoint和通用化支持FastFFN、FusedQKV助力大模型训推;主流模型持续支持更新,提供高效解决方案。

* **2024.04.24 [PaddleNLP v2.8](https://github.com/PaddlePaddle/PaddleNLP/releases/tag/v2.8.0)**:自研极致收敛的RsLoRA+算法,大幅提升PEFT训练收敛速度以及训练效果;引入高性能生成加速到RLHF PPO算法,打破 PPO 训练中生成速度瓶颈,PPO训练性能大幅领先。通用化支持 FastFFN、FusedQKV等多个大模型训练性能优化方式,大模型训练更快、更稳定。

Expand Down
2 changes: 1 addition & 1 deletion README_en.md
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@

## News 📢

* **2024.06.27 [PaddleNLP v3.0 Beta](https://github.com/PaddlePaddle/PaddleNLP/releases/tag/v3.0.0)**:Embrace large models and experience a complete upgrade. With a unified large model toolchain, we achieve full-process access to domestically produced computing chips. We fully support industrial-level application processes for large models, such as PaddlePaddle's 4D parallel configuration, efficient fine-tuning strategies, efficient alignment algorithms, and high-performance reasoning. Our developed RsLoRA+ algorithm, full checkpoint storage mechanism Unified Checkpoint, and generalized support for FastFNN and FusedQKV all contribute to the training and inference of large models. We continuously support updates to mainstream models for providing efficient solutions.
* **2024.06.27 [PaddleNLP v3.0 Beta](https://github.com/PaddlePaddle/PaddleNLP/releases/tag/v3.0.0-beta0)**:Embrace large models and experience a complete upgrade. With a unified large model toolchain, we achieve full-process access to domestically produced computing chips. We fully support industrial-level application processes for large models, such as PaddlePaddle's 4D parallel configuration, efficient fine-tuning strategies, efficient alignment algorithms, and high-performance reasoning. Our developed RsLoRA+ algorithm, full checkpoint storage mechanism Unified Checkpoint, and generalized support for FastFNN and FusedQKV all contribute to the training and inference of large models. We continuously support updates to mainstream models for providing efficient solutions.

* **2024.04.24 [PaddleNLP v2.8](https://github.com/PaddlePaddle/PaddleNLP/releases/tag/v2.8.0)**:Our self-developed RsLoRA+ algorithm with extreme convergence significantly improves the convergence speed and training effectiveness of PEFT training. By introducing high-performance generation acceleration into the RLHF PPO algorithm, we have broken through the generation speed bottleneck in PPO training, achieving a significant lead in PPO training performance. We generally support multiple large model training performance optimization methods such as FastFFN and FusedQKV, making large model training faster and more stable.

Expand Down
Loading