# Crawl4AI

Crawl4AI is a self-hosted ai app. Open-source web crawler and scraper tailored for LLMs, AI agents, and data pipelines. It is open source and self-hosted, installable on Docker Hub and Unraid.

Canonical page: https://ourlocalhost.com/app/687/crawl4ai

## Description

Open-source web crawler and scraper tailored for LLMs, AI agents, and data pipelines.

## Platform availability

Available on 1 of 9 platforms: Unraid.

## Health score

82/100 (Excellent), based on 5 of 5 factors.
- Maintained: 100 (last commit 18 days ago)
- Popular: 99 (85,009 GitHub stars)
- Easy to install: 35 (1 install platform, install notes, Docker image)
- Light to run: 60 (2 GB minimum RAM, runs on ARM)
- Security check: 88 (no serious findings, 2 minor, CI, tests)

## Links

- GitHub: https://github.com/unclecode/crawl4ai
- Docker Hub: https://hub.docker.com/r/unclecode/crawl4ai
- Unraid: https://ca.unraid.net/apps/crawl4ai-0ro89x10qklw7t?q=Crawl4AI
- Official website: https://crawl4ai.com/
- Documentation: https://docs.crawl4ai.com

## Common questions

### How do I enable AI-based features in a self-hosted Crawl4AI setup?

Copy deploy/docker/.llm.env.example to .llm.env in the main Crawl4AI folder and add your LLM API keys. Without this file, AI-based features may not work correctly.

### How is the browser installed when using Crawl4AI from the Python package?

After installing crawl4ai, run crawl4ai-setup, which installs the browser once.

### What address do the Docker examples expect the self-hosted Crawl4AI server to use?

They expect the server on localhost at port 11235. If the address or port is wrong, the example reports a crawl failure.

### How can I confirm a fresh Crawl4AI installation works?

Run the simple hello-world example from the docs after installing. If it fails, fix the installation before trying advanced examples.

### Does Crawl4AI reliably bypass strict anti-crawling protections?

It can simulate users to try to avoid risks, but websites with strict anti-crawling can still be difficult.

### Do I need a Crawl4AI Cloud key to self-host?

No, self-hosting is a separate option: you can run it yourself as a library or as your own Docker server. Crawl4AI Cloud is the hosted version.

---
Source: Our Local Host (https://ourlocalhost.com/app/687/crawl4ai), the self-hosted and open-source app directory.