OpenChat-CPU

A self-hosted, offline, ChatGPT-like chatbot with open source LLM support.

  • AI
  • Home Automation
  • Productivity
  • Tools & Utilities
A self-hosted, offline, ChatGPT-like chatbot with open source LLM support. 100% private, with no data leaving your device.

Platform availability

Available on 1 of 10 platforms

  • Unraid
  • TrueNAS (not listed)
  • Umbrel (not listed)
  • ZimaOS (not listed)
  • Proxmox (not listed)
  • Helm (not listed)
  • Mac (not listed)
  • Windows (not listed)
  • Linux (not listed)
  • Any server (not listed)

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

29/100 Low

Maintained
0last commit 1170 days ago
Popular
3767 GitHub stars
Easy to install
351 install platform, install notes, Docker image
Light to run
1016 GB minimum RAM
Security check
83no serious findings, 2 minor, CI, tests

Availability: platform listings confirmed today, links checked 19 days ago

GitHub stars
67
Open issues
12
Last commit
2023-09-08
Latest release
v1.0.6
License
MIT
Activity
stale

Checked 12 days ago - source: GitHub (edgar971/open-chat)

Resources & Compatibility

Minimum requirements: 16 GB RAM, 6 CPU core(s), 20 GB disk.

Checked 54 days ago - source: Docker Hub image tags and published docs

First-install notes

  • Set your AI keys and defaults first Before starting OpenChat, fill in the environment settings file (the example .env.local) with a working OPENAI_API_KEY or a local OpenChat server address and key, plus your default model and prompt. Without these, the page may open but chatting will fail because the app has no AI backend to call. source
  • Point the app to the local OpenChat server If you start OpenChat's model server as a separate container next to the web app, set OPENAI_API_HOST=http://openchat-server:18888 and OPENAI_API_KEY=openchat-dummy-key in the app's settings. That uses the internal Docker name instead of localhost, so the app can actually reach the model server. source
  • Choosing a model size Pick a large-language-model (LLM) size that fits your available RAM — 7B ≈ 8GB, 13B ≈ 16GB — before launching. source

Fetched today - each note links to its source

Alternatives

No alternatives collected yet.

Common questions

Will a 7B OpenChat model be good enough for a local chatbot?

The model page says 7B OpenChat models can deliver performance on par with ChatGPT.

Does OpenChat work with Ollama WebUI?

Users have run Ollama with OpenChat WebUI, but one reports that answers can be factually wrong and the model may keep giving new wrong facts after correction.

Is OpenChat-CPU useful for receipt data extraction?

A self-hosted user reports that amount extraction works well, but company-name extraction is difficult.

Answers sourced from github.com, www.reddit.com, www.redditmedia.com

Community

Collected 49 days ago - public community threads