# Crawl Log Viewer

Crawl Log Viewer is a standalone web service that retrieves and filters crawl log streams stored as Apache Kafka topics, showing crawler activity with hoverable HTTP status-code explanations so operators running. It is open source and self-hosted, installable on Docker Hub.

Canonical page: https://ourlocalhost.com/app/6490/crawl-log-viewer

## Description

Crawl Log Viewer is a standalone web service that retrieves and filters crawl log streams stored as Apache Kafka topics, showing crawler activity with hoverable HTTP status-code explanations so operators running large-scale crawls can quickly verify what their bots collected.

## Platform availability

Available on 0 of 10 platforms.

## Health score

12/100 (Low), based on 4 of 4 factors.
- Maintained: 0 (last commit 1026 days ago)
- Popular: 0 (0 GitHub stars)
- Easy to install: 25 (0 install platforms, install notes, Docker image)
- Light to run: 50 (2 GB minimum RAM)

## Links

- Docker Hub: https://hub.docker.com/r/ukwa/crawl-log-viewer
- GitHub: https://github.com/ldbiz/crawl-log-viewer

## Common questions

### Can a crawl log be used to diagnose crawler problems?

Yes. A crawl log can show the status of crawled content and help diagnose problems.

### Can it work alongside existing self-hosted monitoring tools?

A self-hoster asked for a lightweight, Docker-friendly web log viewer to complement tools such as Netdata, Dozzle, and Glances.

### Can it view non-Docker log files without a full log aggregator?

A self-hoster asked for a Dozzle-like clean web interface for non-Docker log files, without using a full log aggregator like Loki.

### What do self-hosters want in a home server log monitoring setup?

A self-hoster wanted a simple, maintainable log monitoring solution for a home server.

---
Source: Our Local Host (https://ourlocalhost.com/app/6490/crawl-log-viewer), the self-hosted and open-source app directory.
