llms.py
The self-hosted, OpenAI-compatible AI gateway for text, image & audio — a lightweight CLI, server and OSS Open WebUI alternative for Local and Cloud LLMs
July 20, 2026 - v4 Released! →
One tool, every modality
Generate Anything
From a single self-hosted gateway — chat with 530+ models, create images, and synthesize speech across 24 providers
A fast, private, ChatGPT-like web UI over every local & cloud LLM — with tools, MCP, skills, agents and 200+ system prompts
Create images via Gemini, OpenAI, OpenRouter, Chutes, Z.ai & Nvidia — right inside the chat and gallery workflow
High-quality text-to-speech with Gemini & OpenRouter models, plus voice-to-text input via the microphone
Create → Publish → Showcase
Your Creations, in the Public Gallery
Anything you generate in llms.py can be published with one click — landing in the live showcase at ai.llmspy.org, browsable by everyone with categories, tags, ratings and infinite scroll.
- Browse generated images & audio by category and tag
- Play full Projects built by AI — games and apps, ready to run
- Free & anonymous publisher account — no email required
Playable & self-contained
Projects Built by AI
Complete, self-contained apps & games — generated with llms.py and published for anyone to open and play
Quick Install
pip install llms-py💬 Simple Chat
Ask questions directly from the command line
Run Server
llms --serve 8000Beautiful Themes
Personalize your experience with a selection ofhandcrafted themes
💬 ChatGPT-like Interface
Modern, fast, and privacy-focused web UI for all your local and remote LLMs
What's New
Latest release focused on extensibility, expanded provider support, and enhanced user experience
Powered by models.dev integration with automatic daily updates
Add features, providers, and customize the UI with flexible plugins
RAG workflows with document stores, categories, and contextual chat
Username/Password authentication with Admin UI and CLI user management
Specialized AI agents with custom prompts, tools, themes, and Planner→Coder workflows
Secure workspace isolation that restricts AI agent filesystem access to designated project folders
First-class Python function calling for LLM interactions with your environment
Built-in support for provider hosted Anthropic & OpenRouter server tools like web search
Connect to Model Context Protocol servers for extended tool capabilities
Extend AI capabilities with specialized knowledge, workflows, and tools
AI-powered browser automation with live preview, script editor, and element inspector
Customize the look and feel with built-in themes or create your own
Beautiful UIs to evaluate math and execute Python, JS, TS & C# code
Browse and manage all your generated images and audio in one place
Voice-to-text transcription via microphone button or ALT+D keyboard shortcut
Built-in support for Gemini, OpenAI, OpenRouter, Chutes, Z.ai and Nvidia
TTS support for Gemini 2.5 Flash/Pro Preview models
Beautiful LaTeX math typesetting for equations and formulas
Model Selector
Smart search, advanced filtering, sorting, and favorites over 530 models from 24 providers
Learn more →
Credentials Auth
Built-in Username/Password authentication with a Sign In page, Admin Web UI and CLI for user managing accounts, roles, and account locking
Learn more →
Agent Profiles & Projects
Configure specialized AI agents with custom prompts, tools, and themes — and scope their filesystem access to secure project workspaces
Gemini File Search & RAG
Build knowledge bases with document stores and contextual AI chat
Learn more →
Server Tools
Built-in support for provider-hosted OpenRouter & Anthropic server tools like web search, web fetch & code execution
Learn more →
Agent Browser
An integrated workspace for building and running automated browser scripts with AI assistance, live previews, and an interactive element inspector
Learn more →
Image & Audio Generation
Seamless media generation through UI and CLI
Runtime Provider Management
Enable or disable providers on the fly without configuration changes
Learn more →
Ready to Get Started?
Install llms.py and start chatting with 530+ AI models in minutes