llms.py

A lightweight CLI, API and ChatGPT-style web interface for chatting with multiple large language model (LLM) providers, running entirely offline with all data…

  • AI
A lightweight CLI, API and ChatGPT-style web interface for chatting with multiple large language model (LLM) providers, running entirely offline with all data kept private in browser storage.

Platform availability

Available on 4 of 10 platforms

  • Unraid (not listed)
  • TrueNAS
  • Umbrel (not listed)
  • ZimaOS (not listed)
  • Proxmox (not listed)
  • Helm (not listed)
  • Mac
  • Windows
  • Linux
  • Any server (not listed)

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

66/100 Good

Maintained
100last commit 27 days ago
Popular
56628 GitHub stars
Easy to install
554 install platforms, install notes
Light to run
No data
Security check
201 serious finding, 5 minor, CI, tests

Based on 4 of 5 factors.

Availability: platform listings confirmed today, links checked yesterday

GitHub stars
628
Open issues
2
Last commit
2026-10-25
Latest release
v4.0.26
License
BSD-3-Clause
Activity
steady

Checked 21 days ago - source: GitHub (ServiceStack/llms)

Resources & Compatibility

Requirements not published yet.

First-install notes

  • Start the server on port 8000 Run `llms --serve 8000` to start the local web/API server; if you're running from the cloned folder, use `./llms.sh --serve 8000`. If port 8000 is blocked or not open, your browser or other apps won't be able to connect to it. source
  • Add extra tools with --add Use `llms --add <extension>` or `llms --add <user>/<repo>` to install optional extensions and their needed files. Skipping this step won't stop the main app from working, but those extra tools won't be available. source
  • Keep your extensions folder safe Extensions you add live in the `~/.llms/extensions/` folder, so deleting or moving that folder can remove your custom or community tools. It's a good idea to remember where that folder is, especially if you add private or important extensions. source
  • Download and install Download the latest macOS, Windows or Linux build from the llms.py releases page on GitHub to install the desktop application. source

Fetched 18 days ago - each note links to its source

Alternatives

No alternatives collected yet.

Common questions

How do I start the web UI?

Install with pip install llms-py, set provider API keys, run llms --serve 8000, and open the UI on local port 8000.

Where is chat data stored?

The docs say it is privacy-first and that all data is stored locally in the browser.

Can it automatically switch between providers?

Yes, it includes intelligent routing with automatic failover between providers.

Is there a Docker deployment option?

The docs describe llms.py as Docker-ready with pre-built images, and Docker Deployment is listed in the documentation.

Are there sign-in options?

The documentation lists Authentication, Credentials, ChatGPT Sign-In, and GitHub Auth configuration.

Does it support image and audio workloads?

The site says it supports text, image, and audio, with image generation from several providers plus text-to-speech and voice-to-text input.

Answers sourced from llmspy.org, llmspy.org

Community

Collected 48 days ago - public community threads