VoidLLM
Privacy-first LLM proxy and AI gateway.
First start: Set an Encryption Key and an Admin Key (generate both with [code]openssl rand -base64 32[/code]). On the first start VoidLLM prints the UI login (email + password) and your first API key ([code]vl_uk_...[/code]) to the container log, exactly once. Open the log right after starting and save them.
Important: Never change the Encryption Key after the first start, otherwise all stored upstream API keys become unreadable.
Models and providers can be managed in the web UI. For advanced setups place a [code]voidllm.yaml[/code] in the
Platform availability
Available on 1 of 10 platforms
- Unraid
- TrueNAS (not listed)
- Umbrel (not listed)
- ZimaOS (not listed)
- Proxmox (not listed)
- Helm (not listed)
- Mac (not listed)
- Windows (not listed)
- Linux (not listed)
- Any server (not listed)
Health score
Not enough data yet for a health score. It needs at least 2 of 4 factors: maintenance, popularity, ease of install, resource needs.
Availability: platform listings confirmed today
No GitHub repository data collected yet.
Resources & Compatibility
Requirements not published yet.
Checked today - source: Docker Hub image tags and published docs
First-install notes
No first-install notes yet.
Variants
Alternatives
No alternatives collected yet.
Common questions
Does VoidLLM store or log the actual prompt and response content?
The site says it is a zero-knowledge pass-through and does not store, log, or persist any prompt or response content. It tracks only metadata such as who made the request, which model was used, and how many tokens were consumed.
What does it mean when the log says VOIDLLM_ADMIN_KEY is set but database already has keys, ignoring?
This can be normal on later starts. The admin key is used only on first boot to create the bootstrap user and is ignored after there are already keys in the database.
What proxy overhead is listed in the documentation index?
The docs index describes VoidLLM as a self-hosted, single binary with sub-500us overhead.
Which endpoint and authorization format are shown in the website example?
The example sends a request to the /v1/chat/completions endpoint on port 8080. It uses a Bearer token in the Authorization header that starts with vl_uk.
What does the built-in Web UI let you manage?
The dashboard includes a playground, API key management, teams, models, usage tracking, and settings.
Answers sourced from github.com, voidllm.ai, voidllm.ai
Community
No community discussions collected yet.