👉 See wandb.ai dashboard here 👈
- Put code of your model under
src/models/
- Configure it under
configs/model/your_model.yaml
python run_glue.py model=your_model
and open your wandb dashboard.
python run_glue.py --multirun \
experiment=cola,wnli,mrpc \
model.learning_rate=2e-5,3e-5
Will run 3*2 = 6.
python run_glue.py --multirun \
experiment=cola,wnli,mrpc \
trainer.gpus=2 \ # 2 gpus per task
trainer.precision=16 \ # Mixed 16FP precision
datamodule.batch_size=256 # Beefy batch size
conda env create -f environment.yml
conda activate run-glue
- Lightning-hydra template by ashleve.
- Some functionalities taken from the original run_glue.py.