# VoidLLM

VoidLLM is a self-hosted ai app. Privacy-first LLM proxy and AI gateway. It is open source and self-hosted, installable on Unraid.

Canonical page: https://ourlocalhost.com/app/9070/voidllm

## Description

Privacy-first LLM proxy and AI gateway. One OpenAI-compatible endpoint in front of vLLM, Ollama, OpenAI, Anthropic, Azure, Bedrock and other providers, with load balancing, multi-provider routing, API key management, usage tracking, rate limiting and an MCP gateway. Self-hosted, zero knowledge of your prompts. First start: Set an Encryption Key and an Admin Key (generate both with openssl rand -base64 32 ). On the first start VoidLLM prints the UI login (email + password) and your first API key ( vl_uk_... ) to the container log, exactly once. Open the log right after starting and save them. Important: Never change the Encryption Key after the first start, otherwise all stored upstream API keys become unreadable. Models and providers can be managed in the web UI. For advanced setups place a voidllm.yaml in the

## Platform availability

Available on 1 of 10 platforms: Unraid.

## Links

- Unraid: https://ca.unraid.net/apps/app_3569020e9179fda4
- Official website: https://voidllm.ai
- GitHub: https://github.com/voidmind-io/voidllm
- Documentation: https://voidllm.ai/docs/

## Common questions

### Does VoidLLM store or log the actual prompt and response content?

The site says it is a zero-knowledge pass-through and does not store, log, or persist any prompt or response content. It tracks only metadata such as who made the request, which model was used, and how many tokens were consumed.

### What does it mean when the log says VOIDLLM_ADMIN_KEY is set but database already has keys, ignoring?

This can be normal on later starts. The admin key is used only on first boot to create the bootstrap user and is ignored after there are already keys in the database.

### What proxy overhead is listed in the documentation index?

The docs index describes VoidLLM as a self-hosted, single binary with sub-500us overhead.

### Which endpoint and authorization format are shown in the website example?

The example sends a request to the /v1/chat/completions endpoint on port 8080. It uses a Bearer token in the Authorization header that starts with vl_uk.

### What does the built-in Web UI let you manage?

The dashboard includes a playground, API key management, teams, models, usage tracking, and settings.

---
Source: Our Local Host (https://ourlocalhost.com/app/9070/voidllm), the self-hosted and open-source app directory.
