max-amd-base

Docker image for Modular MAX optimized for AMD ROCm, delivering fast large language model inference on MI200 and MI300 GPUs with an OpenAI-compatible API…

  • AI
  • Tools & Utilities
Docker image for Modular MAX optimized for AMD ROCm, delivering fast large language model inference on MI200 and MI300 GPUs with an OpenAI-compatible API endpoint.

Platform availability

Available on 0 of 10 platforms

  • Unraid (not listed)
  • TrueNAS (not listed)
  • Umbrel (not listed)
  • ZimaOS (not listed)
  • Proxmox (not listed)
  • Helm (not listed)
  • Mac (not listed)
  • Windows (not listed)
  • Linux (not listed)
  • Any server (not listed)

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

10/100 Low

Maintained
No data
Popular
No data
Easy to install
100 install platforms, Docker image
Light to run
106 GB minimum RAM

Based on 2 of 4 factors.

No GitHub repository data collected yet.

Resources & Compatibility

Minimum requirements: 6 GB RAM. ARM (e.g. Raspberry Pi) is not supported.

Checked 54 days ago - source: Docker Hub image tags and published docs

First-install notes

No first-install notes yet.

Alternatives

No alternatives collected yet.

Common questions

Does max-amd-base include ROCm support?

Yes, the container is described as having full support for ROCm.

Is max-amd-base available as a Docker image?

Yes, it is published as the modular/max-amd-base Docker image.

Does the container include many dependencies?

No, the documentation describes it as having minimal dependencies.

Is the image intended for running LLMs?

Yes, it provides a ready-to-use environment for running LLMs on AMD hardware.

Answers sourced from github.com, hub.docker.com

Community

Collected 48 days ago - public community threads