Kestra
Declarative, YAML-based orchestration platform for scheduling and orchestrating data pipelines, ETL jobs, and business workflows.
Overview
Kestra lets teams define workflows in YAML rather than code, making pipelines easy to version, review, and generate programmatically, while still supporting embedded scripts in any language for the actual task logic. It provides built-in scheduling, event triggers, retries, and a UI for monitoring runs.
Kestra is a fit for teams that prefer declarative, language-agnostic workflow definitions over the Python-first approach of Prefect (also in this catalog) - useful for teams with mixed-language pipelines or who want workflows other tools can generate and edit.
- Categories
- Automation
- Languages
- Java
- License
- Apache-2.0
Related Projects
Prefect
Apache-2.0Python-native workflow orchestration platform for building, scheduling, and monitoring data pipelines with ordinary Python code.
- Automation
Argo Workflows
Apache-2.0Kubernetes-native workflow engine that runs each step of a pipeline as a container, orchestrating parallel jobs and multi-step DAGs directly on a cluster.
- Automation
Temporal
MITDurable execution platform that lets developers write reliable, long-running workflows as ordinary code, with retries, state, and failure recovery handled automatically.
- Automation
SeaTunnel
Apache-2.0Distributed data integration platform for moving and transforming data between databases, data lakes, and messaging systems at scale.
- Backend
Spotted an error? Suggest an edit on GitHub.