VoidLLM

Privacy-first LLM proxy and AI gateway.

  • AI
  • Development
  • Network Services
  • Tools & Utilities
Privacy-first LLM proxy and AI gateway. One OpenAI-compatible endpoint in front of vLLM, Ollama, OpenAI, Anthropic, Azure, Bedrock and other providers, with load balancing, multi-provider routing, API key management, usage tracking, rate limiting and an MCP gateway. Self-hosted, zero knowledge of your prompts.

First start: Set an Encryption Key and an Admin Key (generate both with [code]openssl rand -base64 32[/code]). On the first start VoidLLM prints the UI login (email + password) and your first API key ([code]vl_uk_...[/code]) to the container log, exactly once. Open the log right after starting and save them.

Important: Never change the Encryption Key after the first start, otherwise all stored upstream API keys become unreadable.

Models and providers can be managed in the web UI. For advanced setups place a [code]voidllm.yaml[/code] in the

Platform availability

Available on 1 of 10 platforms

  • Unraid
  • TrueNAS (not listed)
  • Umbrel (not listed)
  • ZimaOS (not listed)
  • Proxmox (not listed)
  • Helm (not listed)
  • Mac (not listed)
  • Windows (not listed)
  • Linux (not listed)
  • Any server (not listed)

Health score

Not enough data yet for a health score. It needs at least 2 of 4 factors: maintenance, popularity, ease of install, resource needs.

Availability: platform listings confirmed today

No GitHub repository data collected yet.

Resources & Compatibility

Requirements not published yet.

Checked today - source: Docker Hub image tags and published docs

First-install notes

No first-install notes yet.

Alternatives

No alternatives collected yet.

Common questions

Does VoidLLM store or log the actual prompt and response content?

The site says it is a zero-knowledge pass-through and does not store, log, or persist any prompt or response content. It tracks only metadata such as who made the request, which model was used, and how many tokens were consumed.

What does it mean when the log says VOIDLLM_ADMIN_KEY is set but database already has keys, ignoring?

This can be normal on later starts. The admin key is used only on first boot to create the bootstrap user and is ignored after there are already keys in the database.

What proxy overhead is listed in the documentation index?

The docs index describes VoidLLM as a self-hosted, single binary with sub-500us overhead.

Which endpoint and authorization format are shown in the website example?

The example sends a request to the /v1/chat/completions endpoint on port 8080. It uses a Bearer token in the Authorization header that starts with vl_uk.

What does the built-in Web UI let you manage?

The dashboard includes a playground, API key management, teams, models, usage tracking, and settings.

Answers sourced from github.com, voidllm.ai, voidllm.ai

Community

No community discussions collected yet.