Repository navigation
Passing txt_ids 3d torch.Tensor is deprecated.Please remove the batch dimension and pass it as a 2d torch Tensor #9350
Description
Describe the bug
Passing txt_ids 3d torch.Tensor is deprecated.Please remove the batch dimension and pass it as a 2d torch Tensor
Is the bath_size shouldn't be 1?
Reproduction
accelerate launch train_dreambooth_lora_flux.py
--pretrained_model_name_or_path=$MODEL_NAME
--dataset_name=$DATASET_NAME
--output_dir=$OUTPUT_DIR
--mixed_precision="fp16"
--instance_prompt="a photo of wac linear pendant,black and white,white background"
--caption_column="prompt"
--resolution=512
--train_batch_size=1
--gradient_accumulation_steps=2
--learning_rate=5e-5
--report_to="wandb"
--lr_scheduler="constant"
--lr_warmup_steps=0
--max_train_steps=2000
--repeats=2
--validation_prompt="a photo of wac linear pendant,black and white,white background"
--validation_epochs=50
--num_validation_images=1
--rank=16
--checkpointing_steps=200
--seed="0"
Logs
09/03/2024 10:45:35 - INFO - __main__ - ***** Running training *****
09/03/2024 10:45:35 - INFO - __main__ - Num examples = 26
09/03/2024 10:45:35 - INFO - __main__ - Num batches each epoch = 26
09/03/2024 10:45:35 - INFO - __main__ - Num Epochs = 154
09/03/2024 10:45:35 - INFO - __main__ - Instantaneous batch size per device = 1
09/03/2024 10:45:35 - INFO - __main__ - Total train batch size (w. parallel, distributed & accumulation) = 2
09/03/2024 10:45:35 - INFO - __main__ - Gradient Accumulation steps = 2
09/03/2024 10:45:35 - INFO - __main__ - Total optimization steps = 2000
Steps: 0%| | 0/2000 [00:00<?, ?it/s]
Passing `txt_ids` 3d torch.Tensor is deprecated.Please remove the batch dimension and pass it as a 2d torch Tensor
Steps: 0%| | 0/2000 [00:01<?, ?it/s, loss=0.522, lr=5e-5]
Passing `txt_ids` 3d torch.Tensor is deprecated.Please remove the batch dimension and pass it as a 2d torch TensorSystem Info
- 🤗 Diffusers version: 0.31.0.dev0
- Platform: Linux-5.15.0-47-generic-x86_64-with-glibc2.35
- Running on Google Colab?: No
- Python version: 3.12.3
- PyTorch version (GPU?): 2.3.0+cu121 (True)
- Flax version (CPU?/GPU?/TPU?): not installed (NA)
- Jax version: not installed
- JaxLib version: not installed
- Huggingface_hub version: 0.24.6
- Transformers version: 4.45.0.dev0
- Accelerate version: 0.33.0
- PEFT version: 0.11.1
- Bitsandbytes version: 0.43.3
- Safetensors version: 0.4.4
- xFormers version: not installed
- Accelerator: NVIDIA A40, 49140 MiB
- Using GPU in script?:
- Using distributed or parallel set-up in script?:
Who can help?
No response
Activity
yiyixuxu commentedon Sep 4, 2024
I think you will modify here
diffusers/examples/dreambooth/train_dreambooth_lora_flux.py
Line 994 in 8ecf499
to be same as
diffusers/src/diffusers/pipelines/flux/pipeline_flux.py
Line 363 in 8ecf499
yiyixuxu commentedon Sep 4, 2024
do you want to open a PR to help us?
LifuWang-66 commentedon Sep 11, 2024
Should also change the next line or remove it.
diffusers/examples/dreambooth/train_dreambooth_lora_flux.py
Line 995 in 8ecf499
github-actions commentedon Oct 5, 2024
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.
0x-avi commentedon Oct 10, 2024
hey would love to try this!
fixed issue huggingface#9350, Tensor is deprecated
0x-avi commentedon Oct 11, 2024
okay so all the tests for lora pass using pytest but the thing is i am on a m2 macbook with 8gb ram hence unable to run the script
i know this is a physical limitation and the fact that i cant use any other optimizations like xformers, is there any other alternative?
yiyixuxu commentedon Oct 11, 2024
@0x-74 thanks! please open a PR!
Dreambooth lora flux bug 3dtensor to 2dtensor (#9653)
Dreambooth lora flux bug 3dtensor to 2dtensor (#9653)