dagster-io/dagster
A cloud-native data pipeline orchestrator designed for the development, production, and observation of data assets, featuring integrated lineage, observability, and a declarative programming model.
Core Features
Quick Start
uv add dagster dagster-webserver dagster-dg-cliDetailed Introduction
Dagster is an advanced, cloud-native data orchestration platform that streamlines the entire data development lifecycle, from local development to production. It empowers data teams to define data assets declaratively using Python, ensuring they are built, maintained, and kept up-to-date efficiently. With integrated lineage and observability, Dagster provides deep insights into data flows and asset health. Its robust engine supports scalable, multi-tenant deployments, fostering CI/CD best practices and offering a unified control plane for comprehensive metadata management, ultimately enhancing productivity and data quality.