Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LTX Video #123

Merged
merged 11 commits into from
Dec 18, 2024
+3,090 −155
Merged

LTX Video #123

Show file tree
Hide file tree
Changes from 8 commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
90b0f4e
rename files
a-r-r-o-w Dec 14, 2024
72b864f
ltx finetuning
a-r-r-o-w Dec 16, 2024
ce40f9e
update
a-r-r-o-w Dec 16, 2024
9f145c2
update
a-r-r-o-w Dec 16, 2024
16094f0
improvements
a-r-r-o-w Dec 17, 2024
b56cd10
make style
a-r-r-o-w Dec 17, 2024
3ade509
gradient clipping
a-r-r-o-w Dec 17, 2024
f2ee370
update
a-r-r-o-w Dec 17, 2024
41f5e8b
fix distributed inference
a-r-r-o-w Dec 17, 2024
b39357f
update
a-r-r-o-w Dec 17, 2024
3abbc04
update
a-r-r-o-w Dec 18, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 1 addition & 2 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -118,7 +118,7 @@ Before starting the training, please check whether the dataset has been prepared
for steps in "${MAX_TRAIN_STEPS[@]}"; do
output_dir="/path/to/my/models/cogvideox-lora__optimizer_${optimizer}__steps_${steps}__lr-schedule_${lr_schedule}__learning-rate_${learning_rate}/"

cmd="accelerate launch --config_file $ACCELERATE_CONFIG_FILE --gpu_ids $GPU_IDS training/cogvideox_text_to_video_lora.py \
cmd="accelerate launch --config_file $ACCELERATE_CONFIG_FILE --gpu_ids $GPU_IDS training/cogvideox/cogvideox_text_to_video_lora.py \
--pretrained_model_name_or_path THUDM/CogVideoX-5b \
--data_root $DATA_ROOT \
--caption_column $CAPTION_COLUMN \
Expand Down Expand Up @@ -449,7 +449,6 @@ With `train_batch_size = 4`:
- [ ] vLLM-powered captioning script
- [x] Multi-resolution/frame support in `prepare_dataset.py`
- [ ] Analyzing traces for potential speedups and removing as many syncs as possible
- [ ] Support for QLoRA (priority), and other types of high usage LoRAs methods
- [x] Test scripts with memory-efficient optimizer from bitsandbytes
- [x] Test scripts with CPUOffloadOptimizer, etc.
- [ ] Test scripts with torchao quantization, and low bit memory optimizers (Currently errors with AdamW (8/4-bit torchao))
Expand Down
2 changes: 2 additions & 0 deletions finetrainers/__init__.py
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
from .args import Args, parse_arguments
from .trainer import Trainer
Loading