# Serge

Serge is an archived self-hosted chat interface that runs local large language models (LLMs) with llama.cpp, letting users chat privately without API keys, including on CPU-only systems. It is open source and self-hosted, installable on Unraid.

Canonical page: https://ourlocalhost.com/app/3303/serge

## Description

Serge is an archived self-hosted chat interface that runs local large language models (LLMs) with llama.cpp, letting users chat privately without API keys, including on CPU-only systems.

## Platform availability

Available on 1 of 10 platforms: Unraid.

## Health score

40/100 (Fair), based on 5 of 5 factors.
- Maintained: 0 (GitHub repository is archived)
- Popular: 75 (5,692 GitHub stars)
- Easy to install: 35 (1 install platform, install notes, Docker image)
- Light to run: 30 (4 GB minimum RAM)
- Security check: 88 (no serious findings, 2 minor, CI, tests)

## Links

- GitHub: https://github.com/serge-chat/serge
- Unraid: https://ca.unraid.net/apps/serge-03nqd0t1bs7uzd
- Official website: https://serge.chat

## Common questions

### Which port should I expose for Serge?

The Docker examples map port 8008. The web interface and API are served from that port.

### Which Docker volumes should I mount to preserve models and app data?

Mount weights to /usr/src/app/weights for model files. Mount datadb to /data/db for app data, with the default database file at /data/db/sql_app.db.

### Which environment variables should I set for authentication?

Set SERGE_JWT_SECRET to a random string for auth token encryption. SERGE_SESSION_EXPIRY controls reauthentication and defaults to 60 minutes.

### Where can I find the API documentation?

The API documentation is available under the /api/docs path.

## Alternatives

- ChatGPT: ChatGPT is a generative artificial intelligence chatbot developed by OpenAI and launched in 2022.
- GPT4ALL: GPT4All runs open-source large language models (LLMs) privately on your own hardware, providing a local chat interface and server that need…
- llamagpt: LlamaGPT is a self-hosted, offline, private ChatGPT-like chatbot for Umbrel that runs a Llama 2 model locally so no data leaves your device…

---
Source: Our Local Host (https://ourlocalhost.com/app/3303/serge), the self-hosted and open-source app directory.
