# Trawl

Trawl is a self-hosted web scraping engine and a FlareSolverr / Byparr drop-in replacement. It is open source and self-hosted, installable on TrueNAS and Unraid.

Canonical page: https://ourlocalhost.com/app/3417/trawl

## Description

Trawl is a self-hosted web scraping engine and a FlareSolverr / Byparr drop-in replacement. It bypasses JS challenges and captchas — Cloudflare, Turnstile, Interstitial, reCAPTCHA v2, hCaptcha and GeeTest — and returns cookies + user-agent over a FlareSolverr-compatible API on port 8191. Works out of the box with Prowlarr, Jackett, Sonarr, Radarr and the rest of the *arr stack. Powered by a fingerprint-patched Camoufox (Firefox) browser pool with a 4-tier escalation strategy (plain HTTP fetch -> cached browser session -> fresh Cloudflare solve -> residential proxy). Runs standalone out of the box. For faster repeat requests (bypass cookies cached in Redis), point REDIS_URL at a separate Redis container. Note: this image needs a larger shared-memory segment for the browser pool — the template sets --shm-size=1g via Extra Parameters. Do not remove it.

## Platform availability

Available on 2 of 10 platforms: Unraid, TrueNAS.

## Health score

76/100 (Good), based on 4 of 5 factors.
- Maintained: 100 (last commit 6 days ago)
- Popular: 61 (1,185 GitHub stars)
- Easy to install: 45 (2 install platforms, install notes, Docker image)
- Security check: 77 (no serious findings, 3 minor, CI, tests)

## Links

- TrueNAS: https://apps.truenas.com/catalog/trawl/
- Unraid: https://ca.unraid.net/apps/trawl-1o4q23p06utr4h?q=Trawl
- GitHub: https://github.com/germondai/trawl
- Official website: https://trawl.germondai.com

## Common questions

### Do I need to create a .env file before starting Trawl with Docker?

Yes, copy .env.example to .env and review the values before starting Docker. Skipping this step can cause wrong ports, missing credentials, or failed connections.

### What certificate should I install if I use Trawl as an HTTPS proxy?

Install Trawl's trawl-ca.crt certificate on your browsers or client containers. Without it, secure connections may show certificate errors even if Trawl is working.

### Can Trawl be used with Prowlarr, Sonarr, or Radarr as a FlareSolverr replacement?

Yes, Trawl exposes a FlareSolverr-compatible /v1 endpoint. It works with Prowlarr and other *arr tools out of the box.

### Why might the Trawl API never print ready even though Docker logs show browser launches?

Check whether the Camoufox binary is installed. The API image normally installs it during publication, but if it is missing the API can stay unready.

---
Source: Our Local Host (https://ourlocalhost.com/app/3417/trawl), the self-hosted and open-source app directory.
