# Paperless-ngx Dedupe

Paperless-ngx Dedupe is a self-hosted companion app for Paperless-ngx that finds exact and near-duplicate documents and can extract document metadata using configured language models. It is open source and self-hosted, installable on Unraid.

Canonical page: https://ourlocalhost.com/app/7716/paperless-ngx-dedupe

## Description

Paperless-ngx Dedupe is a self-hosted companion app for Paperless-ngx that finds exact and near-duplicate documents and can extract document metadata using configured language models. It syncs your library through the Paperless API, compares documents with efficient fuzzy similarity checks, and presents each duplicate group side by side before items are moved to the Paperless trash. It is aimed at anyone managing a large scanned document collection who wants to reduce clutter, improve metadata, and keep manual control over deletions.

## Platform availability

Available on 1 of 10 platforms: Unraid.

## Health score

65/100 (Good), based on 5 of 5 factors.
- Maintained: 100 (last commit 10 days ago)
- Popular: 30 (29 GitHub stars)
- Easy to install: 35 (1 install platform, install notes, Docker image)
- Light to run: 50 (2 GB minimum RAM)
- Security check: 82 (no serious findings, 1 minor, CI, tests, OpenSSF Scorecard 6.4/10)

## Links

- Unraid: https://ca.unraid.net/apps/app_359f57adbc5f407a
- GitHub: https://github.com/rknightion/paperless-ngx-dedupe
- Official website: https://m7kni.io/paperless-ngx-dedupe/

## Common questions

### How should I secure the dedupe interface?

It has no built-in authentication, so anyone who can reach the port can review and delete documents with the configured Paperless user's permissions. Keep it LAN-only or put it behind a reverse proxy with access control.

### What Paperless-ngx credential do I configure?

Create an API token in the Paperless-ngx user profile. The Paperless user behind that token needs delete permissions on the documents you want to clean up.

### Are deleted duplicates removed permanently?

No, deleted documents go to the Paperless trash. Review each duplicate group side by side before removing anything.

### Does it provide an API besides the web UI?

Yes, it exposes a REST API and web UI for metadata extraction. It uses LLMs to extract metadata from synced documents.

## Alternatives

- Genius Scan: Genius Scan is a scanner in your pocket.
- Mayan EDMS: Mayan EDMS is a web-based open-source electronic document management system that helps individuals and teams organize, index, and share doc…
- Paperless-ngx: Paperless-ngx is a self-hosted document management system that converts scanned and digital documents into a searchable archive using optic…
- Papermerge: Papermerge is an open-source document management system that archives, organizes, and retrieves digital documents from scanner uploads and…
- Paperwork: Paperwork is a personal document manager for scanned documents (and PDFs).
- Papra: Papra is a lightweight, self-hosted document management and archiving platform that automatically imports, stores, and organises files for…
- Teedy: Teedy is an open-source, lightweight document management system for individuals and small businesses that provides optical character recogn…
- docspell: Docspell assists in organizing your piles of digital documents, resulting from scanners, e-mails and other sources with minimal effort.
- ecodms: EcoDMS is an audit-compliant document management system for self-hosted users that scans, stores, manages, and retrieves data and documents…
- paperless-ng: Paperless-ng is an archived self-hosted document management system for homelab users that indexes scanned documents, stores metadata, and m…

---
Source: Our Local Host (https://ourlocalhost.com/app/7716/paperless-ngx-dedupe), the self-hosted and open-source app directory.
