Ollama Intel GPU

Ollama for Intel Arc GPUs (B580, A770, A750, etc.) powered by Intel IPEX-LLM.

  • AI
  • Tools & Utilities
Ollama for Intel Arc GPUs (B580, A770, A750, etc.) powered by Intel IPEX-LLM. Drop-in replacement for the standard Ollama container — exposes the same API on port 11434. Requires an Intel Arc GPU

Platform availability

Available on 1 of 10 platforms

  • Unraid
  • TrueNAS (not listed)
  • Umbrel (not listed)
  • ZimaOS (not listed)
  • Proxmox (not listed)
  • Helm (not listed)
  • Mac (not listed)
  • Windows (not listed)
  • Linux (not listed)
  • Any server (not listed)

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

42/100 Fair

Maintained
50last commit 231 days ago
Popular
2722 GitHub stars
Easy to install
351 install platform, install notes, Docker image
Light to run
1016 GB minimum RAM
Security check
75no serious findings

Availability: platform listings confirmed today, links checked 32 days ago

GitHub stars
22
Open issues
9
Last commit
2026-04-04
Activity
stale

Checked 9 days ago - source: GitHub (SpaceinvaderOne/ollama-intel-gpu)

Resources & Compatibility

Minimum requirements: 16 GB RAM, 50 GB disk. ARM (e.g. Raspberry Pi) is not supported.

Checked 54 days ago - source: Docker Hub image tags and published docs

First-install notes

  • Make sure Ollama is running first Install and start Ollama before running launch commands for other tools. Without a running Ollama server, the tool can't connect and setup will fail. source
  • Follow the first-run Ollama prompts Open a terminal/command prompt and run `ollama` once, then answer the setup prompts, including signing in if you want cloud models. This completes basic account and model setup so later launches work as expected. source
  • Pick Quick setup in the wizard If the Hermes setup wizard asks how to set up, choose Quick setup first because it is recommended. It configures the provider, model, and messaging for you, reducing the chance of missing a required step. source
  • GPU Device Configuration Set the GPU Device Selector to level_zero:0 (default) unless you have multiple Intel GPUs. source

Fetched 39 days ago - each note links to its source

Alternatives (12)

  • Agora - Agora is a digital shopfront that allows you to sell files directly to others.
  • Alpaca - Ollama Client - Alpaca is an Ollama client where you can manage and chat with multiple models, Alpaca provides an easy and begginer friendly way of interac…
  • AnythingLLM - AnythingLLM is a local, all-in-one AI app for self-hosters that works with any large language model, providing document chat, retrieval-aug…
  • Ensu - Private offline on-device local LLM app by Ente, open source code, no accounts or tracking, and works cross-platform on mobile and desktop…
  • Google AI Edge Gallery - A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
  • Jan.ai - Open-source offline AI chat software supporting local LLMs, cloud model connections, custom assistant creation, OpenAI-compatible API, and…
  • LM Studio - LM Studio is an application for running and experimenting with local large language models (LLMs) such as gpt-oss, Llama, Gemma, Qwen, and…
  • LocalAI - LocalAI is a free, open-source, self-hosted AI engine that provides a drop-in, OpenAI-compatible API for running local models.
  • Ollama - Ollama is a local runtime for large language models (LLMs) that provides an application programming interface (API) and command-line interf…
  • PocketPal - An app that brings language models directly to your phone.
  • Private GPT - Ask questions to your documents without an internet connection, using the power of LLMs.
  • lemonade-server - Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs.

Checked 40 days ago - source: AlternativeTo

Common questions

How can I confirm the container is using the Intel Arc GPU rather than the CPU?

Run the container with the /dev/dri device passed through and inspect the container logs. You should see oneAPI device name: Intel(R) Graphics and library=oneapi in the output.

Where should downloaded Ollama models be stored?

Mount persistent storage to /root/.ollama when using Docker. In Unraid, use the template's Model Storage setting, which defaults to /mnt/user/appdata/ollama-intel-gpu.

How do I connect Open WebUI to this Ollama container?

Point Open WebUI's OLLAMA_BASE_URL at the container's host IP and port 11434. Set OLLAMA_ORIGINS to * so Open WebUI is allowed to make cross-origin requests.

What environment variables control parallelism, context, and model unloading?

OLLAMA_NUM_PARALLEL should stay at 1 for 12 GB cards. OLLAMA_NUM_CTX sets the context window in tokens, and OLLAMA_KEEP_ALIVE sets how long the model remains in VRAM, with -1 keeping it loaded indefinitely.

How can I test the Ollama API?

Query the root health check, /api/tags, or /api/generate on port 11434. You can use curl or the container console to verify that the API is responding.

Answers sourced from github.com

Community

Collected 53 days ago - public community threads