Skip to content

Add transformers v4.49 support#2191

Merged
echarlaix merged 5 commits into
mainfrom
transformers-449
Feb 24, 2025
Merged

Add transformers v4.49 support#2191
echarlaix merged 5 commits into
mainfrom
transformers-449

Conversation

@echarlaix

Copy link
Copy Markdown
Collaborator

No description provided.

@echarlaix
echarlaix marked this pull request as ready for review February 21, 2025 16:51
@HuggingFaceDocBuilderDev

Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@echarlaix

Copy link
Copy Markdown
Collaborator Author

Failing tests

onnxruntime.capi.onnxruntime_pybind11_state.NotImplemented: [ONNXRuntimeError] : 9 : NOT_IMPLEMENTED : Could not find an implementation for ArgMax(13) node with name '/ArgMax'

will be fixed in huggingface/transformers#36332

@echarlaix
echarlaix merged commit f4c9021 into main Feb 24, 2025
@echarlaix
echarlaix deleted the transformers-449 branch February 24, 2025 10:41
@xenova

xenova commented Mar 4, 2025

Copy link
Copy Markdown
Contributor

I've tested converting LlamaForCausalLM models, but I'm running into this error:

Detailed error: Required inputs (['onnx::Gather_7']) are missing from input feed (['input_ids', 'attention_mask', 'position_ids', 'past_key_values.0.key', 'past_key_values.0.value', 'past_key_values.1.key', 'past_key_values.1.value'])..

Command:

optimum-cli export onnx -m hf-internal-testing/tiny-random-LlamaForCausalLM /tmp

I assume onnx::Gather_7 is related to logits_to_keep?

@xenova

xenova commented Mar 4, 2025

Copy link
Copy Markdown
Contributor

Ahh nevermind!! I was on an old version of Optimum 🤦

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants