Modelship CPU
Modelship CPU is a self-hosted, OpenAI-compatible AI inference server that serves multiple reasoning LLM, embedding, speech, and image models on CPU behind…
Platform availability
Available on 1 of 10 platforms
- Unraid
- TrueNAS (not listed)
- Umbrel (not listed)
- ZimaOS (not listed)
- Proxmox (not listed)
- Helm (not listed)
- Mac (not listed)
- Windows (not listed)
- Linux (not listed)
- Any server (not listed)
Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.
56/100 Fair
- Maintained
- 100last commit 6 days ago
- Popular
- 3555 GitHub stars
- Easy to install
- 351 install platform, install notes, Docker image
- Light to run
- No data
- Security check
- 152 serious findings, 9 minor, CI, tests
Based on 4 of 5 factors.
Security check: 2 serious findings
- Uses anyio 4.13.0, which has a known critical vulnerability (PyPI)
- Uses certifi 2025.11.12, which has a known critical vulnerability (PyPI)
Automated checks on commit 44334a2, 13 Nov 2026. Not an audit.
Availability: platform listings confirmed today, links checked 20 days ago
- GitHub stars
- 55
- Open issues
- 0
- Last commit
- 2026-11-15
- Latest release
- v0.10.0
- License
- Apache-2.0
- Activity
- declining
Checked 6 days ago - source: GitHub (modelship-ai/modelship)
Resources & Compatibility
Requirements not published yet.
Checked 54 days ago - source: Docker Hub image tags and published docs
First-install notes
- Create models.yaml before first start Modelship will not start until a models.yaml configuration file is in place at the expected path. Create it before your first launch, using the format and ready-made examples in the model configuration docs. source
Fetched 47 days ago - each note links to its source
Variants
Alternatives
No alternatives collected yet.
Common questions
Can I run a single model without creating models.yaml?
The quick start deploys one model with the --model flag. Use models.yaml when deploying several models at once.
How do I persist downloaded model files?
Mount a named Docker volume to /.cache, such as modelship-cache, so the model cache survives container recreation.
Which port and API base path should clients use?
The CPU example maps host port 8000 to container port 8000. Requests target the /modelship/v1 base path, including /modelship/v1/responses and /modelship/v1/chat/completions.
How many CPU cores should I reserve for a model?
The example reserves four cores with --num-cpus 4. Lower the value if the container has fewer cores because the deploy waits for resources it cannot get.
Does the CPU variant require GPU software?
The CPU quick start uses the latest-cpu image and does not pass GPU flags. The README says NVIDIA GPU deployment needs the NVIDIA Container Toolkit.
Answers sourced from github.com
Community
- Top 10 Model Ship Forums in 2026 (forum)
- Model Ship World Forum: Ship Modeling Tips & Community | Discover ... (forum)
Collected 49 days ago - public community threads