LocalAI
LocalAI is a free, open-source, self-hosted AI engine that provides a drop-in, OpenAI-compatible API for running local models.
Platform availability
Available on 7 of 10 platforms
- Unraid
- TrueNAS
- Umbrel
- ZimaOS (not listed)
- Proxmox
- Helm
- Mac
- Windows (not listed)
- Linux (not listed)
- Any server
Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.
81/100 Excellent
- Maintained
- 100last commit 18 days ago
- Popular
- 9450,176 GitHub stars
- Easy to install
- 857 install platforms, install notes, Docker image
- Light to run
- 2016 GB minimum RAM, runs on ARM
- Security check
- 70no serious findings, 7 minor, CI, tests
Availability: platform listings confirmed today, links checked 10 days ago
- GitHub stars
- 50,176
- Open issues
- 169
- Last commit
- 2026-11-03
- Latest release
- v4.12.1
- License
- MIT
- Activity
- rising
Checked 18 days ago - source: GitHub (mudler/LocalAI)
Resources & Compatibility
Minimum requirements: 16 GB RAM, 4 CPU core(s). ARM (e.g. Raspberry Pi) is supported.
Checked 54 days ago - source: Docker Hub image tags and published docs
First-install notes
- Map port 8080 when starting LocalAI Start LocalAI with port 8080 mapped to your machine, like the Docker example's `-p 8080:8080`, so your browser or apps can connect. Without the port mapping, LocalAI may be running but you cannot reach it. source
- Install a model and its backend first Before using LocalAI, install the backend the model needs (for example llama-cpp) and install at least one model with the provided command. If a backend or model is missing, requests will fail because LocalAI has nothing to load. source
- Test the API after setup After starting LocalAI and installing a model, send a test chat completion request to the /v1/chat/completions endpoint. This helps you confirm the service, model, and network path are working before connecting other apps. source
Fetched 54 days ago - each note links to its source
Variants
Alternatives (12)
- AnythingLLM - AnythingLLM is a local, all-in-one AI app for self-hosters that works with any large language model, providing document chat, retrieval-aug…
- ChatGPT - ChatGPT is a generative artificial intelligence chatbot developed by OpenAI and launched in 2022.
- DeepSeek - DeepSeek is a state-of-the-art AI assistant designed to provide intelligent, conversational support across diverse tasks.
- Euria - Privacy-first AI assistant with chat, writing, transcription, summarization, email, and document tools, hosted in Switzerland and compliant…
- GPT4ALL - GPT4All runs open-source large language models (LLMs) privately on your own hardware, providing a local chat interface and server that need…
- Google Gemini - Gemini gives you direct access to Google AI.
- Hermes Agent - Hermes Agent is a self-improving AI agent by Nous Research that creates and refines skills from experience, builds a persistent model of yo…
- LM Studio - LM Studio is an application for running and experimenting with local large language models (LLMs) such as gpt-oss, Llama, Gemma, Qwen, and…
- Lumo by Proton - Privacy-first AI assistant with zero-access encryption, no logging or profiling, open-source code, and user-controlled conversations, subje…
- Microsoft Copilot - Microsoft Copilot, formerly known as Bing Chat, is an AI chat interface used to converse with Microsoft hosted OpenAI and Claude models wit…
- Ollama - Ollama is a local runtime for large language models (LLMs) that provides an application programming interface (API) and command-line interf…
- OpenClaw - OpenClaw is an open-source, self-hosted AI assistant gateway that connects large language models (LLMs) to Discord, Telegram, and WhatsApp,…
Checked 51 days ago - source: AlternativeTo
Common questions
How do I make LocalAI reachable from my browser or apps?
Map port 8080 when starting LocalAI, such as Docker's -p 8080:8080, so your browser or apps can connect. If the port is not mapped, LocalAI may be running but you cannot reach it.
What must I install before a model can run?
Install the backend the model needs, for example llama-cpp, and install at least one model with the provided command. If a backend or model is missing, requests fail because LocalAI has nothing to load.
Where does LocalAI store model files?
Command line uses ./models, Docker uses /models inside the container typically mounted to ./models, and the launcher uses ~/.localai/models. You can customize the model storage location with the LOCALAI_MODELS_PATH environment variable.
How can I test LocalAI after setup?
After starting LocalAI and installing a model, send a test chat completion request to the /v1/chat/completions endpoint. This confirms the service, model, and network path are working before connecting other apps.
Can I point an existing OpenAI client at LocalAI?
Point an existing client at LocalAI as a drop-in replacement for most OpenAI API calls. It also speaks the Anthropic, Ollama, and ElevenLabs APIs, so most tools need only a URL change.
Answers sourced from localai.io, localai.io, localai.io, localai.io, localai.io
Community
- LocalAI v1.18.0 release! : r/selfhosted - Reddit (reddit)
- LocalAI v2.16.0: Self-Hosted AI with Distributed Inferencing ... - Reddit (reddit)
- LocalAI v1.22.0 is out! : r/selfhosted - Reddit (reddit)
- r/selfhosted on Reddit: LocalAI: OpenAI compatible API to run LLM ... (reddit)
Collected 48 days ago - public community threads