System Info

AutoModelForCausalLM.from_pretrained now returns the above error.

Who can help?

No response

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

pip install transformers

from transformers import AutoModelForCausalLM
AutoModelForCausalLM.from_pretrained(
model_path,
cache_dir= cache_dir,
device_map="auto",
quantization_config=bnb_config,
)

Expected behavior

Expected to load the model.