Search open source projects
5 projects found for "data-pipeline"
SeaTunnel
Apache-2.0Distributed data integration platform for moving and transforming data between databases, data lakes, and messaging systems at scale.
- Backend
Kestra
Apache-2.0Declarative, YAML-based orchestration platform for scheduling and orchestrating data pipelines, ETL jobs, and business workflows.
- Automation
Prefect
Apache-2.0Python-native workflow orchestration platform for building, scheduling, and monitoring data pipelines with ordinary Python code.
- Automation
Beam
Apache-2.0Unified programming model for defining batch and stream data processing pipelines that can run portably across multiple execution engines.
- Analytics
Vector
MPL-2.0High-performance observability data pipeline for collecting, transforming, and routing logs, metrics, and traces.
- Monitoring