Skip to content

Plans to Integrate LongRoPE into LLaMA? #31992

Description

@ryan-minato

Feature request

Microsoft has introduced their microsoft/LongRoPE implementation. Unlike plug-and-play solutions, LongRoPE requires hyperparameter tuning via a genetic algorithm. This implementation is likely the same as described in the Su on Phi-3. Are there any plans to incorporate LongRoPE into LLaMA?

Motivation

In my research on long content, I have managed to integrate LongRoPE into LLaMA with some minor code adjustments.
I am curious if Huggingface is also working on integrating this feature.

Your contribution

If necessary.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions