Skip to content

benitomartin/peft-gemma-2b

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 

Repository files navigation

FINE TUNING GEMMA 2B

crewai

This repository contains a full PEFT pipeline with model quantization and LoRA adapters. The model is hosted in Hugging Face, downloaded with a quantized version and LoRA adapters are added in order to train the model. The trained model/adapters are pushed back to a personal repo in Hugging Face

Feel free to ⭐ and clone this repo 😉

👨‍💻 Tech Stack

Visual Studio Code Jupyter Notebook Python