v0.0.6: Minor updates and bug fix
What's Changed
- [Minor] Update README with an example. by @frankaging in #55
- [Minor] Update README with Colab links. by @frankaging in #56
- [Minor] Update README by @frankaging in #57
- [Major] Support Llama3 models by @frankaging in #64
- [Minor] More refactory to support Llama3 experiments by @frankaging in #74
- [Minor] fix subspace (#72) by @frankaging in #75
- ReFT + DPO Tutorial by @AmirZur in #76
- Title: Fix: Shape Mismatch during Left Padding Adjustment in compute_metrics (Generated by Ana - AI SDE) by @ana-ai-sde in #89
- [P1] support ReFT+PEFT by using ReftModel to wrap PeftModel (#46) by @frankaging in #93
- [Minor] Enable lora with loreft training by @frankaging in #94
- [Minor] Basic support of quantization by @frankaging in #100
- [P0] Revert back to ortho init as unstable training by @frankaging in #103
- Fix: datasets.exceptions.DatasetNotFoundError when training with alpaca_data_cleaned by @savadikarc in #108
- [P0] Fixing LoReFT rotation layer hot loading problem (#114) by @frankaging in #123
New Contributors
- @AmirZur made their first contribution in #76
- @ana-ai-sde made their first contribution in #89
- @savadikarc made their first contribution in #108
Full Changelog: v0.0.5...v0.0.6