Workflow Orchestration Platform
3.8k 2026-04-14
Netflix/maestro
A general-purpose workflow orchestrator providing a fully managed workflow-as-a-service for data and ML pipelines at scale.
Core Features
Provides a fully managed workflow-as-a-service (WAAS).
Highly scalable, scheduling hundreds of thousands of workflows and millions of jobs daily.
Supports diverse users (data scientists, ML engineers, etc.) and use cases.
Extensible architecture to support existing and new use cases.
Kubernetes integration and Python SDK for client interaction.
Quick Start
./gradlew bootRunDetailed Introduction
Maestro is Netflix's robust, general-purpose workflow orchestrator designed to manage complex data and machine learning pipelines at an immense scale. It operates as a fully managed workflow-as-a-service, catering to thousands of internal users including data scientists, engineers, and analysts. Capable of scheduling hundreds of thousands of workflows and millions of jobs daily with strict SLOs, Maestro emphasizes high scalability, extensibility, and enhanced usability, making it a critical component for Netflix's data platform infrastructure.