LocalAI

LocalAI is a free, open-source, self-hosted AI engine that provides a drop-in, OpenAI-compatible API for running local models.

  • AI
  • Other
  • Productivity
  • Tools & Utilities
LocalAI is a free, open-source, self-hosted AI engine that provides a drop-in, OpenAI-compatible API for running local models. It runs text, audio (including voice cloning), image and video models — including GGUF, transformers and diffusers architectures — on consumer-grade hardware, with no GPU required, and pulls each model backend only when needed. It is aimed at homelab users who want OpenAI-style inference on their own hardware, without depending on cloud services.

Platform availability

Available on 7 of 10 platforms

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

81/100 Excellent

Maintained
100last commit 18 days ago
Popular
9450,176 GitHub stars
Easy to install
857 install platforms, install notes, Docker image
Light to run
2016 GB minimum RAM, runs on ARM
Security check
70no serious findings, 7 minor, CI, tests

Availability: platform listings confirmed today, links checked 10 days ago

GitHub stars
50,176
Open issues
169
Last commit
2026-11-03
Latest release
v4.12.1
License
MIT
Activity
rising

Checked 18 days ago - source: GitHub (mudler/LocalAI)

Resources & Compatibility

Minimum requirements: 16 GB RAM, 4 CPU core(s). ARM (e.g. Raspberry Pi) is supported.

Checked 54 days ago - source: Docker Hub image tags and published docs

First-install notes

  • Map port 8080 when starting LocalAI Start LocalAI with port 8080 mapped to your machine, like the Docker example's `-p 8080:8080`, so your browser or apps can connect. Without the port mapping, LocalAI may be running but you cannot reach it. source
  • Install a model and its backend first Before using LocalAI, install the backend the model needs (for example llama-cpp) and install at least one model with the provided command. If a backend or model is missing, requests will fail because LocalAI has nothing to load. source
  • Test the API after setup After starting LocalAI and installing a model, send a test chat completion request to the /v1/chat/completions endpoint. This helps you confirm the service, model, and network path are working before connecting other apps. source

Fetched 54 days ago - each note links to its source

Alternatives (12)

  • AnythingLLM - AnythingLLM is a local, all-in-one AI app for self-hosters that works with any large language model, providing document chat, retrieval-aug…
  • ChatGPT - ChatGPT is a generative artificial intelligence chatbot developed by OpenAI and launched in 2022.
  • DeepSeek - DeepSeek is a state-of-the-art AI assistant designed to provide intelligent, conversational support across diverse tasks.
  • Euria - Privacy-first AI assistant with chat, writing, transcription, summarization, email, and document tools, hosted in Switzerland and compliant…
  • GPT4ALL - GPT4All runs open-source large language models (LLMs) privately on your own hardware, providing a local chat interface and server that need…
  • Google Gemini - Gemini gives you direct access to Google AI.
  • Hermes Agent - Hermes Agent is a self-improving AI agent by Nous Research that creates and refines skills from experience, builds a persistent model of yo…
  • LM Studio - LM Studio is an application for running and experimenting with local large language models (LLMs) such as gpt-oss, Llama, Gemma, Qwen, and…
  • Lumo by Proton - Privacy-first AI assistant with zero-access encryption, no logging or profiling, open-source code, and user-controlled conversations, subje…
  • Microsoft Copilot - Microsoft Copilot, formerly known as Bing Chat, is an AI chat interface used to converse with Microsoft hosted OpenAI and Claude models wit…
  • Ollama - Ollama is a local runtime for large language models (LLMs) that provides an application programming interface (API) and command-line interf…
  • OpenClaw - OpenClaw is an open-source, self-hosted AI assistant gateway that connects large language models (LLMs) to Discord, Telegram, and WhatsApp,…

Checked 51 days ago - source: AlternativeTo

Common questions

How do I make LocalAI reachable from my browser or apps?

Map port 8080 when starting LocalAI, such as Docker's -p 8080:8080, so your browser or apps can connect. If the port is not mapped, LocalAI may be running but you cannot reach it.

What must I install before a model can run?

Install the backend the model needs, for example llama-cpp, and install at least one model with the provided command. If a backend or model is missing, requests fail because LocalAI has nothing to load.

Where does LocalAI store model files?

Command line uses ./models, Docker uses /models inside the container typically mounted to ./models, and the launcher uses ~/.localai/models. You can customize the model storage location with the LOCALAI_MODELS_PATH environment variable.

How can I test LocalAI after setup?

After starting LocalAI and installing a model, send a test chat completion request to the /v1/chat/completions endpoint. This confirms the service, model, and network path are working before connecting other apps.

Can I point an existing OpenAI client at LocalAI?

Point an existing client at LocalAI as a drop-in replacement for most OpenAI API calls. It also speaks the Anthropic, Ollama, and ElevenLabs APIs, so most tools need only a URL change.

Answers sourced from localai.io, localai.io, localai.io, localai.io, localai.io

Community

Collected 48 days ago - public community threads