AnythingLLM
All-in-one AI app with RAG over documents, agents and MCP; works with local runners and any OpenAI-compatible API.
- License
- MIT
- Platforms
- Windows, macOS, Linux, Docker
- Own API keys
- Yes
- Checked
- 2026-09-24
AnythingLLM works with OpenAI-compatible APIs. Grab a free key and a model from the catalog: for coding · for agents · providers and base URLs
AnythingLLM alternatives
Self-hosted, offline-capable AI chat platform for Ollama and any OpenAI-compatible API, with RAG, tools, pipelines and multi-user.
Self-hosted multi-provider ChatGPT-style UI with agents, MCP, custom OpenAI-compatible endpoints, RAG and multi-user auth.
Agent-focused AI chat workspace with many providers, Ollama, MCP plugins and a knowledge base; self-host, cloud or desktop.
Desktop multi-LLM client with 300+ assistants, agents and a knowledge base; supports cloud APIs, Ollama/LM Studio and custom endpoints.
Cross-platform desktop chat client for OpenAI, Claude, Gemini, Ollama and other APIs.
Locally installed power-user LLM frontend for chat and roleplay with KoboldCpp, Ollama, OpenAI, OpenRouter, image generation and TTS.
FAQ
Is AnythingLLM free?
The desktop app and self-hosted Docker version are free with no token limits; the managed cloud is paid.
Does AnythingLLM work with free models?
Yes. It supports your own keys and OpenAI-compatible APIs, so you can plug in free models from OpenRouter, Groq, NVIDIA Build, or a local Ollama.
What license does AnythingLLM use?
MIT. The source code is open.