Data Prepper

Data Prepper is an open source data collector from the OpenSearch project that ingests, filters, enriches, transforms, and aggregates observability data such…

  • Databases
  • Monitoring & Logging
  • Tools & Utilities
Data Prepper is an open source data collector from the OpenSearch project that ingests, filters, enriches, transforms, and aggregates observability data such as logs, traces, and metrics. It normalises that data for downstream analysis and visualisation, letting homelab operators build lightweight telemetry pipelines without extra tooling.

Platform availability

Available on 1 of 10 platforms

  • Unraid (not listed)
  • TrueNAS (not listed)
  • Umbrel (not listed)
  • ZimaOS (not listed)
  • Proxmox (not listed)
  • Helm
  • Mac (not listed)
  • Windows (not listed)
  • Linux (not listed)
  • Any server (not listed)

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

61/100 Good

Maintained
100last commit 2 days ago
Popular
52381 GitHub stars
Easy to install
351 install platform, install notes, Docker image
Light to run
No data
Security check
201 serious finding, 16 minor, CI, tests

Based on 4 of 5 factors.

Availability: platform listings confirmed today

GitHub stars
381
Open issues
845
Last commit
2026-11-19
Latest release
2.16.0
License
Apache-2.0
Activity
rising

Checked 2 days ago - source: GitHub (opensearch-project/data-prepper)

Resources & Compatibility

ARM (e.g. Raspberry Pi) is supported.

Checked 54 days ago - source: Docker Hub image tags and published docs

First-install notes

  • Install the Laravel Data package Run `composer require spatie/laravel-data` in your Laravel project, where Composer (the PHP package manager) adds the needed code. Without this, your app cannot find the Laravel Data classes and the examples in these docs will not work. source
  • Publish the optional config file If you need to change how the package behaves, run the shown `php artisan vendor:publish` command to save a config file for your project. If you skip it, defaults still work, but you may not have a clear place to adjust Laravel Data's settings later. source
  • Use data objects in controllers When you add a controller (the code that handles web requests), you can inject a data object like `PostData` so Laravel checks incoming values before your code runs. Without that automatic validation, bad or missing values can be saved or cause confusing errors later. source
  • Deployment Deploy with the official Docker image or Helm chart and connect it to an OpenSearch cluster; it currently handles distributed-trace and log ingestion, with metric support planned. source

Fetched 42 days ago - each note links to its source

Alternatives

No alternatives collected yet.

Common questions

Can Data Prepper collect different observability data types?

Yes. It is described as a collector for observability data, including traces, logs, and metrics.

Can Data Prepper clean and shape data before downstream analysis?

Yes. It can filter, enrich, transform, normalize, and aggregate data for downstream analysis and visualization.

Can trace analytics in Data Prepper help find application performance problems?

Yes. Trace analytics can help visualize event flows and identify performance problems.

What happens when Data Prepper’s circuit breaker is triggered?

It helps prevent Java heap memory exhaustion. When triggered, Data Prepper rejects incoming data.

Answers sourced from docs.opensearch.org, docs.opensearch.org, github.com

Community

Collected 48 days ago - public community threads