Webrender-har-daemon

A companion daemon for web archivists using the Heritrix3 crawler that monitors a URL queue, submits each received URL to a page-rendering web service, and…

  • Automation
  • Development
  • Tools & Utilities
A companion daemon for web archivists using the Heritrix3 crawler that monitors a URL queue, submits each received URL to a page-rendering web service, and stores the response as a modified HAR (HTTP Archive) record for transcluded content.

Platform availability

Available on 0 of 10 platforms

  • Unraid (not listed)
  • TrueNAS (not listed)
  • Umbrel (not listed)
  • ZimaOS (not listed)
  • Proxmox (not listed)
  • Helm (not listed)
  • Mac (not listed)
  • Windows (not listed)
  • Linux (not listed)
  • Any server (not listed)

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

6/100 Low

Maintained
0last commit 3965 days ago
Popular
00 GitHub stars
Easy to install
250 install platforms, install notes, Docker image
Light to run
No data

Based on 3 of 4 factors.

GitHub stars
0
Open issues
0
Last commit
2016-01-13
Activity
stale

Checked 18 days ago - source: GitHub (uk-gov-mirror/ukwa.webrender-har-daemon)

Resources & Compatibility

ARM (e.g. Raspberry Pi) is not supported.

Checked 54 days ago - source: Docker Hub image tags and published docs

First-install notes

  • How it works Monitors a queue to which Heritrix submits URLs; each received URL is forwarded to a rendering web service (currently django-phantomjs) and the response is stored as a modified HAR record. source

Fetched 42 days ago - each note links to its source

Alternatives

No alternatives collected yet.

Common questions

How does webrender-har-daemon receive URLs to process?

It monitors a queue to which Heritrix submits URLs.

What service is used to process each received URL?

The URL is submitted to a webservice, currently via django-phantomjs.

Where is the rendered output stored?

The response is stored as a modified HAR record in a WARC file.

Can it be deployed from Docker?

A Docker image is available for webrender-har-daemon.

Answers sourced from github.com, hub.docker.com

Community

Collected 48 days ago - public community threads