# Llama-swap

Llama-swap is a lightweight, zero-dependency tool that lets you run multiple generative AI models on your machine and hot-swap between them on demand. It is open source and self-hosted, installable on Unraid.

Canonical page: https://ourlocalhost.com/app/2993/llama-swap

## Description

Llama-swap is a lightweight, zero-dependency tool that lets you run multiple generative AI models on your machine and hot-swap between them on demand. It works with any OpenAI- and Anthropic-API-compatible server, making it an easy way to power local AI workflows.

## Platform availability

Available on 1 of 10 platforms: Unraid.

## Health score

72/100 (Good), based on 5 of 5 factors.
- Maintained: 100 (last commit 8 days ago)
- Popular: 76 (6,252 GitHub stars)
- Easy to install: 35 (1 install platform, install notes, Docker image)
- Light to run: 10 (8 GB minimum RAM)
- Security check: 94 (no serious findings, 1 minor, CI, tests)

## Links

- Unraid: https://ca.unraid.net/apps/llama-swap-19po8u30fxo51z?q=llama-swap

## Common questions

### Can I front multiple local model servers without replacing my existing OpenAI or Anthropic clients?

Yes. llama-swap acts as a reverse proxy and supports any OpenAI and Anthropic API compatible server, so clients can send requests to it while it hot-swaps backends.

### Does llama-swap include a local helper for configuration questions?

Yes. The Help page in the sidebar is an agent that calls llama-swap documentation tools and answers configuration questions using config.example.yaml and the knowledge base, running entirely on a local model.

### Where should I look when a model process does not start or misbehaves?

Use the common issues catalog, which covers the lifecycle of the Process entity, configuration pitfalls, and environmental conflicts.

### Can it manage several LLMs on one server without manually starting and stopping them?

Yes. Llama-Swap is positioned to handle starting/stopping different models so you can switch between them on a single server.

---
Source: Our Local Host (https://ourlocalhost.com/app/2993/llama-swap), the self-hosted and open-source app directory.
