Skip to content

Latest commit

 

History

History
8 lines (5 loc) · 278 Bytes

README.md

File metadata and controls

8 lines (5 loc) · 278 Bytes

SMART_LLM

the repo for building SMART_LLM

Vicuna Training

done

  • 目前完成了 LoRA 版的 Vicuna 7B Fine-Tuning, 可以在Deepspeed Stage 2和Stage 3上进行ft,具体配置可以参考vicuna_ds_config_2n8u.yaml