Dagster

Dagster is a cloud-native data pipeline orchestrator for developing, running, and monitoring data assets such as tables, models, and reports, featuring…

  • Automation
  • Databases
  • Tools & Utilities
Dagster is a cloud-native data pipeline orchestrator for developing, running, and monitoring data assets such as tables, models, and reports, featuring integrated lineage, observability, and a declarative Python programming model.

Platform availability

Available on 1 of 10 platforms

  • Unraid (not listed)
  • TrueNAS (not listed)
  • Umbrel (not listed)
  • ZimaOS (not listed)
  • Proxmox (not listed)
  • Helm
  • Mac (not listed)
  • Windows (not listed)
  • Linux (not listed)
  • Any server (not listed)

Health score?A 0-100 score computed nightly from four factors: maintained (40%: recent commits and steady activity), popular (25%: GitHub stars, log scale), easy to install (20%: platforms, install notes, setup guides, Docker image) and light to run (15%: minimum RAM, ARM support). When the source code has been checked, a fifth factor, security check (20%: automated scan for committed secrets, unsafe desktop-app settings, known-vulnerable dependencies and project hygiene; any serious finding caps it at 20), is added. Factors without data are left out and the rest are rescaled.

74/100 Good

Maintained
100last commit 14 days ago
Popular
8416,376 GitHub stars
Easy to install
251 install platform, install notes
Light to run
502 GB minimum RAM

Availability: platform listings confirmed today

GitHub stars
16,376
Open issues
2625
Last commit
2026-11-07
Latest release
1.13.29
License
Apache-2.0
Activity
steady

Checked 14 days ago - source: GitHub (dagster-io/dagster)

Resources & Compatibility

Minimum requirements: 2 GB RAM.

Checked 40 days ago - source: Docker Hub image tags and published docs

First-install notes

  • Create the example project first For an example project, run the listed `dagster project from-example ...` command, change into the new folder, and install the dependencies with `pip install -e ".[dev]"`. This gives Dagster the example code and required packages, so the web UI has something to run instead of erroring out. source
  • Start the web UI after installing After the install finishes, run `dagster-webserver` to start the web dashboard. This is the interface you use to view your workflows, so without it you cannot configure or launch the workflow in a browser. source
  • Fill in .env before running If the example includes a `.env.example` file, copy it to `.env` and replace the placeholder values with your own credentials before starting. This keeps account secrets out of your code and stops the example from failing because it cannot connect to the external service. source

Fetched 40 days ago - each note links to its source

Alternatives (2)

  • Apache Airflow - Airflow is a platform to programmaticaly author, schedule and monitor data pipelines.
  • TaskYak - The TaskYak is a distributed, team-based task orchestration platform.

Checked 54 days ago - source: AlternativeTo

Common questions

Does self-hosted open-source Dagster include built-in authentication for the Dagit UI?

No. The source says Dagit lacks any type of auth, including even a simple HTTP password.

Which services should I account for when allocating resources in a self-hosted Docker Compose setup?

The source describes a Docker Compose setup that distributes resources between dagster-api, dagster-db, dagster-daemon, dagster-webserver, and other services.

Can Dagster be configured for separate development, test, and production ETL workloads?

The source discusses setting up Dagster to run ETL workloads across development, test, and production environments.

Can I self-host Dagster instead of using the managed platform?

Yes. The docs say you can deploy Dagster open source, which is separate from the managed Dagster+ platform.

Answers sourced from docs.dagster.io, github.com, www.reddit.com, www.reddit.com

Community

Collected 48 days ago - public community threads