# OpenChat-Cuda

OpenChat-Cuda is a self-hosted ai app. A self-hosted, offline, ChatGPT-like chatbot that runs open-source LLMs locally using CUDA on an NVIDIA GPU, keeping conversations private and local. It is open source and self-hosted, installable on Unraid.

Canonical page: https://ourlocalhost.com/app/3154/openchat-cuda

## Description

A self-hosted, offline, ChatGPT-like chatbot that runs open-source LLMs locally using CUDA on an NVIDIA GPU, keeping conversations private and local.

## Platform availability

Available on 1 of 10 platforms: Unraid.

## Health score

17/100 (Low), based on 5 of 5 factors.
- Maintained: 0 (last commit 1170 days ago)
- Popular: 37 (67 GitHub stars)
- Easy to install: 35 (1 install platform, install notes, Docker image)
- Light to run: 10 (8 GB minimum RAM)
- Security check: 15 (2 serious findings, 16 minor, CI, tests)

## Security check

2 serious findings: Uses form-data 4.0.0, which has a known critical vulnerability; Uses i18next-fs-backend 2.1.1, which has a known critical vulnerability.
Automated checks on commit 5781c9d, 12 Nov 2026. Not an audit.

## Links

- Unraid: https://ca.unraid.net/apps/openchat-cuda-1sb2fiz16eqlnj?q=OpenChat-Cuda
- Documentation: https://github.com/buggyhunter/openchat-ui
- GitHub: https://github.com/edgar971/open-chat

## Common questions

### Which compose command starts the 13B model?

Run docker compose -f docker-compose-13b.yml up -d. The 13B q4_0 model requires at least 16GB RAM.

### Which local port should a reverse proxy target?

Use port 3000 because the README says the app is accessible at localhost:3000.

### How do I set the model path and context length in Docker?

Add environment variables to the api service, such as MODEL=/path/to/your/model and N_CTX=4096. Additional API settings can also be passed as arguments to run.sh.

### Can OpenChat 3.5 7B run on a Pascal GPU?

The source only shows a Reddit question asking whether it works. It does not include a confirmed result.

---
Source: Our Local Host (https://ourlocalhost.com/app/3154/openchat-cuda), the self-hosted and open-source app directory.
