| apache/airflow |
33,219 |
|
0 |
320 |
about 2 years ago |
169 |
November 27, 2023 |
890 |
apache-2.0 |
Python |
| Apache Airflow - A platform to programmatically author, schedule, and monitor workflows |
| airbytehq/airbyte |
12,918 |
|
0 |
11 |
about 2 years ago |
311 |
December 08, 2023 |
5,111 |
other |
Python |
| The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted. |
| dagster-io/dagster |
9,467 |
|
2 |
133 |
about 2 years ago |
585 |
December 07, 2023 |
2,343 |
apache-2.0 |
Python |
| An orchestration platform for the development, production, and observation of data assets. |
| mage-ai/mage-ai |
6,324 |
|
0 |
0 |
about 2 years ago |
314 |
December 06, 2023 |
189 |
apache-2.0 |
Python |
| 🧙 The modern replacement for Airflow. Build, run, and manage data pipelines for integrating and transforming data. |
| kestra-io/kestra |
5,257 |
|
0 |
4 |
about 2 years ago |
58 |
November 28, 2023 |
464 |
apache-2.0 |
Java |
| Infinitely scalable, event-driven, language-agnostic orchestration and scheduling platform to manage millions of workflows declaratively in code. |
| orchest/orchest |
3,876 |
|
0 |
0 |
almost 3 years ago |
19 |
December 13, 2022 |
125 |
apache-2.0 |
TypeScript |
| Build data pipelines, the easy way 🛠️ |
| pawl/awesome-etl |
3,041 |
|
0 |
0 |
about 2 years ago |
0 |
|
12 |
|
|
| A curated list of awesome ETL frameworks, libraries, and software. |
| mara/mara-pipelines |
2,033 |
|
0 |
1 |
over 2 years ago |
8 |
December 06, 2023 |
26 |
mit |
Python |
| A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow |
| reugn/go-streams |
1,656 |
|
0 |
8 |
about 2 years ago |
19 |
October 17, 2022 |
15 |
mit |
Go |
| A lightweight stream processing library for Go |
| instill-ai/vdp |
1,556 |
|
0 |
1 |
about 2 years ago |
42 |
November 29, 2023 |
0 |
other |
Makefile |
| 💧 Instill VDP (Versatile Data Pipeline) is an open-source tool to seamlessly integrate AI to process unstructured data in the modern data stack |
