# max-amd-base

max-amd-base is a self-hosted ai app. Docker image for Modular MAX optimized for AMD ROCm, delivering fast large language model inference on MI200 and MI300 GPUs with an OpenAI-compatible API endpoint. It is open source and self-hosted, installable on Docker Hub.

Canonical page: https://ourlocalhost.com/app/5421/max-amd-base

## Description

Docker image for Modular MAX optimized for AMD ROCm, delivering fast large language model inference on MI200 and MI300 GPUs with an OpenAI-compatible API endpoint.

## Platform availability

Available on 0 of 10 platforms.

## Health score

10/100 (Low), based on 2 of 4 factors.
- Easy to install: 10 (0 install platforms, Docker image)
- Light to run: 10 (6 GB minimum RAM)

## Links

- Docker Hub: https://hub.docker.com/r/modular/max-amd-base

## Common questions

### Does max-amd-base include ROCm support?

Yes, the container is described as having full support for ROCm.

### Is max-amd-base available as a Docker image?

Yes, it is published as the modular/max-amd-base Docker image.

### Does the container include many dependencies?

No, the documentation describes it as having minimal dependencies.

### Is the image intended for running LLMs?

Yes, it provides a ready-to-use environment for running LLMs on AMD hardware.

---
Source: Our Local Host (https://ourlocalhost.com/app/5421/max-amd-base), the self-hosted and open-source app directory.
