Is Matryoshka dead?
Every frontier embedding model uses MRL.
But we tested it across a full hyperparameter sweep and it's lossy at every dimension.
A small projection matrix trained on top of zembed-1 beats MRL across the board. Including at full dim.
Results:
zembed-1 @ 160
Super excited to share that @ZeroEntropy_AI is now a provider in the @vercel AI SDK
If you're already building with `ai`, our models are one import away.
→ zerank-2 for reranking
→ zembed-1 for embeddings
→ more models to come 👀
Happy shipping!
The excellent zerank-2 reranker model by @ZeroEntropy_AI is now fully compatible with Sentence Transformers, no `trust_remote_code=True` needed.
It's 4B and cc-by-nc-4.0, and performs very well.
I'm quite fond of their training methodology, I'll explain in the 🧵
On Gemini Flash 3.5 pricing
Prices for mini/Flash models have been dramatically increasing with every release
4x increase on input and more than 8x on output between Gemini 1.5 Flash and Gemini 2.5 Flash
And now another 3x increase
The world needs more cost efficient,
zembed-1 is finally here!
🔥 The world's best embedding model, by @ZeroEntropy_AI
It outperforms @OpenAI , @GeminiApp , @Alibaba_Qwen , and Voyage's latest embeddings on 100+ languages, and across verticals.
Available now via our API/SDK, @huggingface, and @awscloud
We just built a free tool to ask questions over the 2025 @NeurIPSConf research papers.
Try it out at neurips dot zeroentropy dot dev
No signup, no credit card, just the best way to learn more about this year's papers!
It’s always amazing to see small teams outperform companies with $100M+ in funding, and even more amazing when you get to be a part of it. 😅
Stoked that we were able to support @ZeroEntropy_AI on training their state of the art reranker model family!
Read here about the
We are very excited to release zerank-2, @ZeroEntropy_AI 's newest reranker model. 🔥
It shows major improvement on the 5 most common RAG failure modes below.
Existing rerankers consistently fail on seemingly “simple” tasks:
🔢 Comparing numbers and date: “Biggest deals closed