Skip to content

Add support for Jina reranker architecture #326

@rdner

Description

@rdner

Is your feature request related to a problem? Please describe.
I tried to load the jina-reranker-v3-mlx model as a reranker model.
oMLX failed to load it with the Unsupported reranker architecture: JinaForRanking. error.

Image

Describe the solution you'd like
Add support for the Jina reranker architecture.

Since I'm not an expert in this area, I don't really know if it's a reasonable request or how much effort it would require to implement this.

Additional context
Honestly, there are not that many options when it comes to reranker models available for oMLX.

According to Jina's benchmark results, it's the best available reranker at the moment:

Image

and there is an official MLX variant.

I think it deserves to be supported.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions