AnythingLLM

AnythingLLM is a local, all-in-one AI app for self-hosters that works with any large language model, providing document chat, retrieval-augmented generation,…

  • AI
  • Other
  • Productivity
  • Tools & Utilities
AnythingLLM is a local, all-in-one AI app for self-hosters that works with any large language model, providing document chat, retrieval-augmented generation, and configurable AI agents.

Platform availability

Available on 9 of 10 platforms

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

81/100 Excellent

Maintained
100last commit 21 days ago
Popular
9767,820 GitHub stars
Easy to install
1009 install platforms, install notes, setup guide, Docker image
Light to run
602 GB minimum RAM, runs on ARM
Security check
201 serious finding, 5 minor, CI, tests

Availability: platform listings confirmed today, links checked 7 days ago

GitHub stars
67,820
Open issues
362
Last commit
2026-10-30
Latest release
v1.19.0
License
MIT
Activity
steady

Checked 20 days ago - source: GitHub (Mintplex-Labs/anything-llm)

Resources & Compatibility

Minimum requirements: 2 GB RAM, 2 CPU core(s), 5 GB disk. ARM (e.g. Raspberry Pi) is supported.

Checked 54 days ago - source: Docker Hub image tags and published docs

First-install notes

  • Map a folder for Docker storage and port Before running the Docker command, make sure the storage folder and empty .env file exist on your host, and that port 3001 is not already in use. That folder keeps your settings and files safe after restarts, while port 3001 is how you open AnythingLLM in a browser. source
  • Run the Linux desktop installer as a normal user Run the Linux installer from a folder you can write to, and avoid running it as root. If you use root, it can create permissions that make the app hard to use or update with your normal account. source
  • Use Homebrew to install on macOS On a Mac, run brew install --cask anythingllm in your terminal to install the desktop app. This is the first step before you can open AnythingLLM and connect your AI model or documents. source
  • Desktop install Download the macOS, Windows, or Linux desktop installer from the AnythingLLM GitHub Releases page. source

Fetched 33 days ago - each note links to its source

Alternatives (12)

  • Alpaca - Ollama Client - Alpaca is an Ollama client where you can manage and chat with multiple models, Alpaca provides an easy and begginer friendly way of interac…
  • ChatGPT - ChatGPT is a generative artificial intelligence chatbot developed by OpenAI and launched in 2022.
  • Claude - AI assistant for chat and API, performing summarization, search, writing, Q&A, and coding with high reliability, customizability, priva…
  • DeepSeek - DeepSeek is a state-of-the-art AI assistant designed to provide intelligent, conversational support across diverse tasks.
  • Ensu - Private offline on-device local LLM app by Ente, open source code, no accounts or tracking, and works cross-platform on mobile and desktop…
  • GPT4ALL - GPT4All runs open-source large language models (LLMs) privately on your own hardware, providing a local chat interface and server that need…
  • Jan.ai - Open-source offline AI chat software supporting local LLMs, cloud model connections, custom assistant creation, OpenAI-compatible API, and…
  • Khoj - Khoj is an open-source AI personal assistant and second brain.
  • LM Studio - LM Studio is an application for running and experimenting with local large language models (LLMs) such as gpt-oss, Llama, Gemma, Qwen, and…
  • LibreChat - LibreChat is an open-source, self-hosted, multi-provider AI chat interface that provides a ChatGPT-style experience for teams or individual…
  • LocalAI - LocalAI is a free, open-source, self-hosted AI engine that provides a drop-in, OpenAI-compatible API for running local models.
  • Lumo by Proton - Privacy-first AI assistant with zero-access encryption, no logging or profiling, open-source code, and user-controlled conversations, subje…

Checked 51 days ago - source: AlternativeTo

Common questions

What host files and port do I need before starting AnythingLLM with Docker?

Create the storage folder and an empty .env file on the host before running the Docker command. Port 3001 must be free, and the storage folder is what keeps your settings and files after restarts.

Does the self-hosted AnythingLLM server support multiple users?

Yes, multi-user instance support and permissioning are available. The README marks this as a Docker version-only feature.

Can I embed an AnythingLLM chat widget on my website?

Yes, AnythingLLM includes a custom embeddable chat widget. The README lists this as available for the Docker version only.

Answers sourced from docs.anythingllm.com, github.com

Community

Collected 47 days ago - public community threads

Install guides