You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 591dd2f
Browse filesBrowse the repository at this point in the historyBrowse files
docs: swap Ollama example for Infron LLM gateway in custom LLM provider doc (anomalyco#1477)
* docs: swap Ollama functional example for Infron LLM gateway
Introduces the LLM gateway concept (single OpenAI-compatible endpoint,
unified billing, fallbacks), replaces the Ollama walkthrough with an
Infron config, and links out to Infron's signup + quickstart per their
reciprocal doc in their OpenWork page.
* docs: frame Infron as hosted gateway vs LiteLLM starting point
Link to Infron's LiteLLM integration page as the canonical open-source
gateway reference, and position Infron as the OpenRouter-style hosted
gateway that sits on top: one key, unified billing, provider fallbacks.
* docs: drop OpenRouter comparison, pitch Infron directly for dev ergonomics
* docs: drop em dashes, loosen Infron pitch to devrel voice
* docs: add Infron model picker + active session screenshots
Copy file name to clipboardExpand all lines: packages/docs/cloud/share-with-your-team/custom-llm-provider.mdx
+28-27Lines changed: 28 additions & 27 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -68,63 +68,64 @@ The JSON must include `id`, `name`, `npm`, `env`, `doc`, and `models`. `api` is
68
68
3. Under `Cloud providers`, click `Import`.
69
69
4. Reload the workspace when OpenWork asks.
70
70
71
-
### Functional example: Ollama (Qwen3 8B)
71
+
### Functional example: an LLM gateway (Infron)
72
72
73
-
This setup a local [Ollama](https://docs.ollama.com/api/openai-compatibility) instance running `qwen3:8b`.
74
-
Ollama's OpenAI-compatible endpoint requires an API key but ignores the value, so paste anything (for example `ollama`) into the `API key / credential` field when creating the provider.
73
+
An LLM gateway is one OpenAI-compatible endpoint that fans out to many model providers. If you want to run the routing yourself, [LiteLLM](https://infron.ai/docs/frameworks-and-integrations/litellm) is a good starting point. [Infron](https://infron.ai) is the hosted option: one API key gets you every model in its [marketplace](https://infron.ai/models) with automatic provider fallbacks and a single invoice, so adding a new LLM to OpenWork is just another entry under `models`.
75
74
76
-
<Frame>
77
-

78
-
</Frame>
75
+
Grab a key from the [API Keys dashboard](https://infron.ai/dashboard/apiKeys). If you don't have an account yet, sign up at [infron.ai/login](https://infron.ai/login) and their [quickstart](https://infron.ai/docs/overview/quickstart/text) walks you through your first request.
76
+
77
+
Paste the key into `API key / credential` and use this JSON:
Once imported, Infron models show up in the Chat model picker alongside everything else:
116
+
120
117
<Frame>
121
-

118
+

122
119
</Frame>
123
120
124
-
Pull the model first with `ollama pull qwen3:8b`, then make sure the Ollama server is reachable at `http://localhost:11434` with `ollama serve`
121
+
Pick the model and it's live in the session footer:
122
+
123
+
<Frame>
124
+

0 commit comments