/

data-engineering

data-science
python
etl
data-integration
data
data-analysis
data-visualization
machine-learning
workflow
elt
orchestration
pipeline
analytics
business-intelligence
mlops
data-quality
sql
data-orchestrator
data-pipelines
scheduler
automation
dbt
big-data
dashboard
react
apache
bi
business-analytics
data-analytics
data-viz
sql-editor
deep-learning

apache/superset
351日前56.6k

Apache Superset is a Data Visualization and Data Exploration Platform

flask
data-analysis
python
data-visualization
data-science
react
analytics
apache
apache-superset
asf
bi
business-analytics
business-intelligence
data-analytics
data-engineering
data-viz
+2

GokuMohandas/Made-With-ML
347日前35.1k

Learn how to design, develop, deploy and iterate on production-grade ML applications.

deep-learning
python
data-science
machine-learning
data-engineering
llms
mlops
pytorch
natural-language-processing
data-quality
distributed-ml
ray
distributed-training

apache/airflow
345日前33.6k

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

python
airflow
apache-airflow
dag
data-orchestrator
data-pipelines
data-science
machine-learning
apache
data-engineering
workflow
scheduler
automation
data-integration
elt
etl

eugeneyan/applied-ml
345日前25.7k

📚 Papers & tech blogs by companies sharing their work on data science & machine learning in production.

deep-learning
applied-machine-learning
applied-data-science
recsys
data-discovery
data-science
machine-learning
data-engineering
search
computer-vision
natural-language-processing
reinforcement-learning
data-quality
production

DataTalksClub/data-engineering-zoomcamp
345日前21.1k

Free Data Engineering course!

kafka
docker
dbt
prefect
data-engineering
spark

PrefectHQ/prefect
345日前14.1k

Prefect is a workflow orchestration tool empowering developers to build, observe, and react to data pipelines

python
prefect
ml-ops
data-ops
data-science
data-engineering
workflow
orchestration
observability
automation
infrastructure
workflow-engine
pipeline
data

airbytehq/airbyte
346日前13.2k

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.

data-analysis
snowflake
data-pipeline
python
java
data-engineering
bigquery
mssql
redshift
pipeline
change-data-capture
data-integration
elt
etl
data-collection
data

andkret/Cookbook
346日前12.7k

The Data Engineering Cookbook

data-engineer
cookbook
data-engineering
best-practices
big-data

datastacktv/data-engineer-roadmap
346日前11.8k

Roadmap to becoming a data engineer in 2021

data-engineer-roadmap
data-engineering
cloud
roadmap

dagster-io/dagster
345日前9.7k

An orchestration platform for the development, production, and observation of data assets.

python
data-orchestrator
data-pipelines
dagster
data-science
analytics
data-engineering
workflow
orchestration
scheduler
metadata
mlops
workflow-automation
data-integration
etl

benthosdev/benthos
345日前7.2k

Fancy stream processing made operationally mundane

kafka
stream-processor
event-sourcing
amqp
nats
go
data-engineering
golang
logs
message-bus
stream-processing
streaming-data
rabbitmq
cqrs
etl
message-queue

mage-ai/mage-ai
345日前6.5k

🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data.

python
sql
data-pipelines
dbt
data-science
machine-learning
data-engineering
orchestration
spark
artificial-intelligence
pipelines
pipeline
data-integration
elt
etl
data

Avaiga/taipy
345日前5.5k

Turns Data and AI algorithms into production-ready web applications in no time.

python
data-visualization
data-ops
taipy-gui
taipy-core
hacktoberfest
data-engineering
hacktoberfest2023
workflow
orchestration
automation
developer-tools
mlops
datascience
pipelines
pipeline

cloudquery/cloudquery
347日前5.4k

The open source high performance data integration platform built for developers.

data-analysis
sql
aws
azure
github-api
kubernetes
data-engineering
bigquery
gcp
data-integration
elt
etl
etl-framework
data-collection
airbyte
data

kestra-io/kestra
345日前5.4k

Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code.

data-pipeline
data-orchestrator
data-orchestration
reverse-etl
data-engineering
workflow
orchestration
scheduler
workflow-engine
pipeline
data-quality
data-integration
elt
etl
low-code
data

feast-dev/feast
345日前5.1k

Feature Store for Machine Learning

python
features
feature-store
data-science
machine-learning
data-engineering
ml
big-data
mlops
data-quality

whoiskatrin/sql-translator
346日前3.9k

SQL Translator is a tool for converting natural language queries into SQL code using artificial intelligence. This project is 100% free and open source.

data-analysis
postgresql
sql
data-engineering
query
dataset
openai
datascience
dataquery

evidence-dev/evidence
345日前2.9k

Business intelligence as code: build fast, interactive data visualizations in pure SQL and markdown..

sql
svelte
duckdb
data-visualization
dbt
data-science
open-source
tailwindcss
analytics
business-intelligence
data-engineering
dashboard
self-hosted
statistics
finance
exploratory-data-analysis

running-elephant/datart
345日前1.7k

Datart is a next generation Data Visualization Open Platform

data-analysis
typescript
data-visualization
datart
davinci
react
analytics
bi
business-analytics
business-intelligence
data-analytics
data-engineering
data-viz
sql-editor
chart
dashboard

kantord/just-dashboard
346日前1.6k

:bar_chart: :clipboard: Dashboards using YAML or JSON files

data-visualization
data-science
json
d3
business-intelligence
data-engineering
chart
d3js
data-driven
dashboard
gist
github-gist
big-data
csv
yaml
data