Tags: #etl

SeaTunnel is a high-performance, distributed data integration tool designed to synchronize massive amounts of multimodal data from diverse sources with efficiency and stability.

An open-source ETL solution for transforming complex documents into clean, structured data formats, optimized for language models.

A robust open-source platform for programmatically authoring, scheduling, and monitoring data workflows.

DataChain is a Python-based AI-data warehouse for transforming, analyzing, and versioning unstructured multimodal data like video, audio, PDFs, and images.

A Python library for building modular, testable, and self-documenting data transformation DAGs with built-in lineage and metadata tracking.

A cloud-native data pipeline orchestrator designed for the development, production, and observation of data assets, featuring integrated lineage, observability, and a declarative programming model.

Prefect is a Python-based workflow orchestration framework designed to build resilient and dynamic data pipelines, automating complex data processes with features like scheduling, caching, and retries.

An open-source platform designed to facilitate all aspects of data and metadata orchestration, enabling efficient data integration and pipeline management.

Integrate dbt Core projects seamlessly into Apache Airflow DAGs and Task Groups, enabling robust data transformation orchestration.