# Granite 3.1 1B A400M Instruct

Granite 3.1 1B A400M Instruct is a lightweight, multilingual IBM language model that runs on your own hardware, letting homelabbers privately answer questions, write and summarise text, and perform coding, reasoning,. It is open source and self-hosted, installable on Docker Hub.

Canonical page: https://ourlocalhost.com/app/5532/granite-3-1-1b-a400m-instruct

## Description

Granite 3.1 1B A400M Instruct is a lightweight, multilingual IBM language model that runs on your own hardware, letting homelabbers privately answer questions, write and summarise text, and perform coding, reasoning, and tool-use tasks.

## Platform availability

Available on 0 of 6 install platforms.

## Health score

28/100 (Low), based on 4 of 4 factors.
- Maintained: 0 (GitHub repository is archived)
- Popular: 43 (147 GitHub stars)
- Easy to install: 25 (0 install platforms, install notes, Docker image)
- Light to run: 80 (1 GB minimum RAM, runs on ARM)

## Links

- GitHub: https://github.com/ibm-granite/granite-3.1-language-models
- Docker Hub: https://hub.docker.com/r/redhat/granite-3-1b-a400m-instruct

## Common questions

### What context length should I expect when running Granite 3.1?

Granite 3.1 extends the context length of Granite 3.0 from 4K to 128K.

### How many experts does the 1B-A400M MoE use at inference?

It is a Mixture-of-Experts decoder transformer with 32 experts and 8 active.

### Can I offer it as a commercial self-hosted API?

Yes. The models are publicly released under an Apache 2.0 license for both research and commercial use.

### Does the instruct model support tool calling workflows?

Granite 3.1 instruction models provide an improved developer experience for function-calling and RAG generation tasks.

### What data does the 1B-A400M instruct checkpoint use for tuning?

It is finetuned from the base model using open source instruction datasets with permissive licenses and internally collected synthetic datasets tailored for long context.

---
Source: Our Local Host (https://ourlocalhost.com/app/5532/granite-3-1-1b-a400m-instruct), the self-hosted and open-source app directory.