llms.py
A lightweight CLI, API and ChatGPT-style web interface for chatting with multiple large language model (LLM) providers, running entirely offline with all data…
Platform availability
Available on 4 of 10 platforms
Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.
66/100 Good
- Maintained
- 100last commit 27 days ago
- Popular
- 56628 GitHub stars
- Easy to install
- 554 install platforms, install notes
- Light to run
- No data
- Security check
- 201 serious finding, 5 minor, CI, tests
Based on 4 of 5 factors.
Security check: 1 serious finding
- Uses zip 4.6.1, which has a known critical vulnerability (crates.io)
Automated checks on commit cc90dc2, 30 Oct 2026. Not an audit.
Availability: platform listings confirmed today, links checked yesterday
- GitHub stars
- 628
- Open issues
- 2
- Last commit
- 2026-10-25
- Latest release
- v4.0.26
- License
- BSD-3-Clause
- Activity
- steady
Checked 21 days ago - source: GitHub (ServiceStack/llms)
Resources & Compatibility
Requirements not published yet.
First-install notes
- Start the server on port 8000 Run `llms --serve 8000` to start the local web/API server; if you're running from the cloned folder, use `./llms.sh --serve 8000`. If port 8000 is blocked or not open, your browser or other apps won't be able to connect to it. source
- Add extra tools with --add Use `llms --add <extension>` or `llms --add <user>/<repo>` to install optional extensions and their needed files. Skipping this step won't stop the main app from working, but those extra tools won't be available. source
- Keep your extensions folder safe Extensions you add live in the `~/.llms/extensions/` folder, so deleting or moving that folder can remove your custom or community tools. It's a good idea to remember where that folder is, especially if you add private or important extensions. source
- Download and install Download the latest macOS, Windows or Linux build from the llms.py releases page on GitHub to install the desktop application. source
Fetched 18 days ago - each note links to its source
Variants
Alternatives
No alternatives collected yet.
Common questions
How do I start the web UI?
Install with pip install llms-py, set provider API keys, run llms --serve 8000, and open the UI on local port 8000.
Where is chat data stored?
The docs say it is privacy-first and that all data is stored locally in the browser.
Can it automatically switch between providers?
Yes, it includes intelligent routing with automatic failover between providers.
Is there a Docker deployment option?
The docs describe llms.py as Docker-ready with pre-built images, and Docker Deployment is listed in the documentation.
Are there sign-in options?
The documentation lists Authentication, Credentials, ChatGPT Sign-In, and GitHub Auth configuration.
Does it support image and audio workloads?
The site says it supports text, image, and audio, with image generation from several providers plus text-to-speech and voice-to-text input.
Answers sourced from llmspy.org, llmspy.org
Community
Collected 48 days ago - public community threads