Skip to content

Add LLMSlim integration (document compressor) - #655

Open
Thanatos9404 wants to merge 1 commit into
deepset-ai:mainfrom
Thanatos9404:add-llmslim
Open

Thanatos9404 wants to merge 1 commit into
deepset-ai:mainfrom
Thanatos9404:add-llmslim

Conversation

@Thanatos9404

@Thanatos9404 Thanatos9404 commented Oct 12, 2026 •

Copy link
Copy Markdown

This adds integrations/llmslim.md for LLMSlim, an MIT-licensed Python library. Its LLMSlimDocumentCompressor is a Haystack component (2.x and 3) that sits between a retriever and the prompt builder. It keeps the query-relevant parts of the retrieved documents within a token budget. It runs locally: lexical ranking by default, or an optional 22M cross-encoder.

I couldn't find a compression or context-pruning component in the catalog yet, so this one may help people who need to fit retrieved documents into a prompt budget.

Disclosure: I'm the maintainer.

@Thanatos9404
Thanatos9404 requested a review from a team as a code owner October 12, 2026 18:50
@vercel

vercel Bot commented Oct 12, 2026

Copy link
Copy Markdown

@Thanatos9404 is attempting to deploy a commit to the deepset Team on Vercel.

A member of the Team first needs to authorize it.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant