Skip to content

Can I use ollama embedding feature on my device #270

Description

@harrisonyao

Hi there,

I configured the .env file to use local ollama embedding service with openroute, but I found the failed create embedder error as below:

Failed to create embedder. Primary provider (openrouter) and all fallback providers failed. Original error: Provider 'openrouter' does not support embedding models. Please configure embedding models in providers/openrouter.yaml

and my the relevance params in the .env configuration file as below:

# Embedding use ollama
EMBEDDER_API_KEY=
EMBEDDER_BASE_URL=http://127.0.0.1:11434
EMBEDDER_MODEL_ID=Qwen/Qwen3-Embedding-4B
EMBEDDER_DIMENSION=2560

So, my question is : How can use my local embedding model service with ollama

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions