# Unsloth

Unsloth is a cross-platform desktop app (Windows, macOS, Linux) that lets you download, run, and fine-tune open-source large language models on your own hardware, bundling a notebook-based Studio, a curated model. It is open source and self-hosted, installable on Proxmox and Docker Hub.

Canonical page: https://ourlocalhost.com/app/7706/unsloth

## Description

Unsloth is a cross-platform desktop app (Windows, macOS, Linux) that lets you download, run, and fine-tune open-source large language models on your own hardware, bundling a notebook-based Studio, a curated model catalog with one-click installs, and accelerated LoRA and QLoRA training so AI developers can work locally without a cloud GPU.

## Platform availability

Available on 3 of 10 platforms: Proxmox, Mac, Linux.

## Desktop and other devices

Mac, Linux.

## Health score

86/100 (Excellent), based on 3 of 4 factors.
- Maintained: 100 (last commit 8 days ago)
- Popular: 98 (79,440 GitHub stars)
- Easy to install: 45 (3 install platforms, install notes)

## Links

- desktop: https://github.com/unslothai/unsloth/releases/latest
- Proxmox: https://community-scripts.github.io/ProxmoxVE/scripts?id=unsloth
- GitHub: https://github.com/unslothai/unsloth
- Official website: https://unsloth.ai
- Docker Hub: https://hub.docker.com/r/unsloth/unsloth

## Common questions

### Can I run Unsloth with Docker?

Yes, Unsloth provides an unsloth/unsloth Docker image for Docker-based installation.

### Which accelerators does Unsloth support?

It supports multi-GPU setups with NVIDIA, AMD, and Intel GPUs, plus CPUs and the Vulkan backend.

### Can I use the local model from another device?

You can access the local models from any device on the LAN, or remotely through secure Cloudflare HTTPS.

### Does Unsloth provide an OpenAI-compatible endpoint?

Yes, you can serve Unsloth models through an OpenAI-compatible API.

### Can I limit file access when a model executes commands?

Unsloth includes sandboxing to restrict which files the model can access while running commands.

## Alternatives

- LLaMA Factory(Nvidia GPU): LLaMA Factory is an open-source, self-hosted framework for fine-tuning and serving large language models on NVIDIA GPU hardware.
- Mistral Forge: Transform institutional knowledge into frontier-grade LLMs—without infrastructure burden or cloud lock-in.

---
Source: Our Local Host (https://ourlocalhost.com/app/7706/unsloth), the self-hosted and open-source app directory.
