Strata

Strata runs the Qwen3.8-Flash-Next mixture-of-experts model on one NVIDIA GPU plus system RAM, and serves an OpenAI- and Anthropic-compatible API, a chat page…

  • AI
Strata runs the Qwen3.8-Flash-Next mixture-of-experts model on one NVIDIA GPU plus system RAM, and serves an OpenAI- and Anthropic-compatible API, a chat page and a live monitor. Requirements: the Nvidia Driver plugin on driver 580 or newer; an RTX 20/30/40/50 card with 12 GB of VRAM or more; an AVX2 CPU; 48-62 GB of free RAM depending on the model; 70-90 GB of disk on an SSD pool. First start: downloads the model (about 70 GB for IQ2_XS) and sets it up, which can take a few hours. Watch the log; it resumes if it stops. Later starts go straight to serving, and loading the model into RAM takes 1-3 minutes. Changing settings later: switching Model or Model family needs nothing extra. Changing context, vision, KV cache, API key or low-RAM mode for a model already set up needs Reinstall = 1 for one start (nothing is downloaded again), then set it back to 0. No API key by default: anyone who

Platform availability

Available on 1 of 9 platforms

  • Unraid
  • TrueNAS (not listed)
  • Umbrel (not listed)
  • ZimaOS (not listed)
  • Proxmox (not listed)
  • Helm (not listed)
  • Mac (not listed)
  • Windows (not listed)
  • Linux (not listed)

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

68/100 Good

Maintained
79last commit 1 day ago
Popular
8825,328 GitHub stars
Easy to install
201 install platform, Docker image
Light to run
No data
Security check
67no serious findings, 3 minor, tests

Based on 4 of 5 factors.

Availability: platform listings confirmed today

GitHub stars
25,328
Open issues
959
Last commit
2026-10-13
Latest release
v0.1.44.1
License
MIT
Activity
rising

Checked today - source: GitHub (Niko1221/Strata)

Resources & Compatibility

Requirements not published yet.

Checked today - source: Docker Hub image tags and published docs

First-install notes

No first-install notes yet.

Alternatives

No alternatives collected yet.

Common questions

How long does the first start of Strata take?

The first start downloads the model, about 70 GB for IQ2_XS, and sets it up, which can take a few hours. Later starts load the model into RAM in 1-3 minutes.

Do I need to reinstall Strata to switch models or change context settings?

Switching Model or Model family needs nothing extra. Changing context, vision, KV cache, API key, or low-RAM mode for a model already set up needs Reinstall = 1.

Can two or three GPUs be used for one Strata model?

Two or three cards can share the model.

Does the Strata installer configure the rest of the environment?

The installer sets up everything else.

Answers sourced from github.com

Community

No community discussions collected yet.