# Granite 3 2B Instruct

Granite 3 2B Instruct is a compact open-source instruction-tuned language model from IBM that runs privately on your own hardware for local chat, drafting, summarising, and answering questions. It is open source and self-hosted, installable on Docker Hub.

Canonical page: https://ourlocalhost.com/app/5618/granite-3-2b-instruct

## Description

Granite 3 2B Instruct is a compact open-source instruction-tuned language model from IBM that runs privately on your own hardware for local chat, drafting, summarising, and answering questions.

## Platform availability

Available on 0 of 10 platforms.

## Health score

35/100 (Low), based on 5 of 5 factors.
- Maintained: 0 (GitHub repository is archived)
- Popular: 62 (1,249 GitHub stars)
- Easy to install: 25 (0 install platforms, install notes, Docker image)
- Light to run: 40 (3.66016 GB minimum RAM, runs on ARM)
- Security check: 75 (no serious findings)

## Links

- Docker Hub: https://hub.docker.com/r/redhat/granite-3-2b-instruct
- Documentation: https://huggingface.co/ibm-granite/granite-3-2b-instruct
- Official website: https://huggingface.co/collections/ibm-granite/granite-code-models-6624c5cec322e4c148c8b330

## Common questions

### Can chain-of-thought reasoning be enabled or disabled for Granite 3.2 2B Instruct?

Yes. The IBM community post says the 8B and 2B Instruct models offer experimental chain-of-thought reasoning that can be toggled on or off to help follow complex instructions.

### Which port does the example SGLang command use, and should it be opened on the network?

The example SGLang command uses port 30000 and --host 0.0.0.0. Open port 30000 only if another device should connect; if you only use it locally, you don't need to expose it.

### What should be done if model startup complains that accelerate is missing?

Use pip to install accelerate. The discussion says this small helper package is needed for some initialization steps and prevents the setup from failing.

### Is there a Raspberry Pi 5 guide for running Granite 3.2-2B locally?

Yes. The granitepi repository contains a diagram and a walkthrough guide for a DIY Raspberry Pi 5 + IBM Granite 3.2-2b local model.

## Alternatives

- Civitai: Civitai is the only Model-sharing hub for the AI art generation community!
- Cleverbot: Cleverbot is an AI web application that learns how to mimic human conversations by conversing with humans.
- Kuki: Browser-based AI chat bot.
- Replicate Codex: Search Replicate AI models.

---
Source: Our Local Host (https://ourlocalhost.com/app/5618/granite-3-2b-instruct), the self-hosted and open-source app directory.
