etl
data-engineering
data-integration
elt
python
data
data-orchestrator
data-pipelines
data-science
workflow
scheduler
pipeline
orchestration
machine-learning
data-analysis
data-pipeline
bigquery
data-collection
sql
airflow
apache-airflow
dag
apache
automation
snowflake
java
mssql
redshift
change-data-capture
dagster
analytics
metadata
mlops
apache/airflow501日前33.6k
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
airbytehq/airbyte502日前13.2k
The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
dagster-io/dagster501日前9.7k
An orchestration platform for the development, production, and observation of data assets.
benthosdev/benthos501日前7.2k
Fancy stream processing made operationally mundane
mage-ai/mage-ai501日前6.5k
🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.
cloudquery/cloudquery503日前5.4k
The open source high performance data integration platform built for developers.
kestra-io/kestra501日前5.4k
Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.