astronomer/astronomer-cosmos
Integrate dbt Core projects seamlessly into Apache Airflow DAGs and Task Groups, enabling robust data transformation orchestration.
Core Features
Detailed Introduction
Astronomer Cosmos is an open-source project designed to bridge the gap between dbt Core projects and Apache Airflow. It allows users to seamlessly integrate their dbt data transformation workflows directly into Airflow DAGs and Task Groups with minimal code. By leveraging Airflow's robust orchestration capabilities, Cosmos enables benefits such as using Airflow connections for dbt, isolating dbt dependencies in virtual environments, implementing data-aware scheduling, and transforming individual dbt models into manageable Airflow tasks with built-in features like retries and alerting. This enhances the reliability and observability of data pipelines.