LlamaGPT
LlamaGPT is a self-hosted, offline, private ChatGPT-like chatbot for Umbrel that runs a Llama 2 model locally so no data leaves your device, but it is no…
Platform availability
Available on 1 of 10 platforms
- Unraid (not listed)
- TrueNAS (not listed)
- Umbrel
- ZimaOS (not listed)
- Proxmox (not listed)
- Helm (not listed)
- Mac (not listed)
- Windows (not listed)
- Linux (not listed)
- Any server (not listed)
Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.
10/100 Low
- Maintained
- 0last commit 1192 days ago
- Popular
- 61 GitHub stars
- Easy to install
- 351 install platform, install notes, Docker image
- Light to run
- 105 GB minimum RAM
Availability: platform listings confirmed today, links checked 15 days ago
- GitHub stars
- 1
- Open issues
- 0
- Last commit
- 2023-08-17
- License
- GPL-3.0
- Activity
- stale
Checked 5 days ago - source: GitHub (0xSynapse/LlamaGPT)
Resources & Compatibility
Minimum requirements: 5 GB RAM, 5.5 GB disk.
Checked 54 days ago - source: Docker Hub image tags and published docs
First-install notes
- Hardware requirements The download is about 5.5 GB and the app uses roughly 5 GB of RAM; 8 GB or more is recommended for Umbrel Home. source
Fetched 39 days ago - each note links to its source
Variants
Alternatives
No alternatives collected yet.
Common questions
Can I install LlamaGPT on a Docker host that is not Umbrel?
Yes. The Reddit post says it can be installed on umbrelOS or anywhere with Docker.
Can I try LlamaGPT before self-hosting it?
Yes. The GitHub repo mentions a hosted Gradio demo in Hugging Face Spaces.
Does LlamaGPT keep usage data local?
The Reddit post describes LlamaGPT as offline and private, so it is positioned as keeping data local.
Does LlamaGPT use an open-source model?
Yes. The GitHub repo describes it as a Gradio demo for Llama 2, an open source large language model by Meta AI.
Answers sourced from github.com, www.reddit.com, www.reddit.com
Community
- llama-gpt: A self-hosted, offline, ChatGPT-like chatbot ... - Reddit (reddit)
- LlamaGPT - Self-hosted, offline, private AI chatbot, powered ... - Reddit (reddit)
- LlamaGPT - Self-hosted, offline, private AI chatbot, powered ... - Reddit (reddit)
- LlamaGPT - Self-hosted, offline, private AI chatbot, powered ... - Reddit (reddit)
- LlamaGPT - Self-hosted, offline, private AI chatbot, powered ... - Reddit (reddit)
- LlamaGPT (private self-hosted chatbot) now supports chatting ... - Reddit (reddit)
Collected 49 days ago - public community threads