# Data Prepper

Data Prepper is an open source data collector from the OpenSearch project that ingests, filters, enriches, transforms, and aggregates observability data such as logs, traces, and metrics. It is open source and self-hosted, installable on Docker Hub and Kubernetes (Helm).

Canonical page: https://ourlocalhost.com/app/6403/data-prepper

## Description

Data Prepper is an open source data collector from the OpenSearch project that ingests, filters, enriches, transforms, and aggregates observability data such as logs, traces, and metrics. It normalises that data for downstream analysis and visualisation, letting homelab operators build lightweight telemetry pipelines without extra tooling.

## Platform availability

Available on 1 of 10 platforms: Helm.

## Health score

61/100 (Good), based on 4 of 5 factors.
- Maintained: 100 (last commit 2 days ago)
- Popular: 52 (381 GitHub stars)
- Easy to install: 35 (1 install platform, install notes, Docker image)
- Security check: 20 (1 serious finding, 16 minor, CI, tests)

## Security check

1 serious finding: A private key is committed in the source code.
Automated checks on commit 0f40c48, 2 Nov 2026. Not an audit.

## Links

- Official website: https://opensearch.org/docs/latest/clients/data-prepper/index/
- GitHub: https://github.com/opensearch-project/data-prepper
- Docker Hub: https://hub.docker.com/r/opensearchproject/data-prepper
- Kubernetes (Helm): https://artifacthub.io/packages/helm/opensearch-project-helm-charts/data-prepper
- Documentation: https://docs.opensearch.org/latest/data-prepper/

## Common questions

### Can Data Prepper collect different observability data types?

Yes. It is described as a collector for observability data, including traces, logs, and metrics.

### Can Data Prepper clean and shape data before downstream analysis?

Yes. It can filter, enrich, transform, normalize, and aggregate data for downstream analysis and visualization.

### Can trace analytics in Data Prepper help find application performance problems?

Yes. Trace analytics can help visualize event flows and identify performance problems.

### What happens when Data Prepper’s circuit breaker is triggered?

It helps prevent Java heap memory exhaustion. When triggered, Data Prepper rejects incoming data.

---
Source: Our Local Host (https://ourlocalhost.com/app/6403/data-prepper), the self-hosted and open-source app directory.
