from transformers import AutoConfig
model = 'deepseek-ai/deepseek-coder-33b-instruct'
model = 'togethercomputer/Llama-2-7B-32K-Instruct'
AutoConfig.from_pretrained(model)
Traceback (most recent call last):
File "/home/jon/h2ogpt/checkropetype.py", line 6, in <module>
AutoConfig.from_pretrained(model, rope_scaling=1)
File "/home/jon/miniconda3/envs/h2ogpt/lib/python3.10/site-packages/transformers/models/auto/configuration_auto.py", line 996, in from_pretrained
return config_class.from_dict(config_dict, **unused_kwargs)
File "/home/jon/miniconda3/envs/h2ogpt/lib/python3.10/site-packages/transformers/configuration_utils.py", line 772, in from_dict
config = cls(**config_dict)
File "/home/jon/miniconda3/envs/h2ogpt/lib/python3.10/site-packages/transformers/models/llama/configuration_llama.py", line 192, in __init__
rope_config_validation(self)
File "/home/jon/miniconda3/envs/h2ogpt/lib/python3.10/site-packages/transformers/modeling_rope_utils.py", line 546, in rope_config_validation
validation_fn(config)
File "/home/jon/miniconda3/envs/h2ogpt/lib/python3.10/site-packages/transformers/modeling_rope_utils.py", line 379, in _validate_linear_scaling_rope_parameters
rope_type = rope_scaling["rope_type"]
KeyError: 'rope_type'
System Info
transformers 4.31.1 is broken, 4.24.4 was ok
Who can help?
@ArthurZucker
Information
Tasks
examplesfolder (such as GLUE/SQuAD, ...)Reproduction
for either model, gives now:
Expected behavior
no errors