Tags: #data-pipelines

Dynamic, resilient open-source orchestrator for building scalable and reproducible data and ML pipelines on Kubernetes.

A general-purpose workflow orchestrator providing a fully managed workflow-as-a-service for data and ML pipelines at scale.

Prefect is a Python-based workflow orchestration framework designed to build resilient and dynamic data pipelines, automating complex data processes with features like scheduling, caching, and retries.