| airbytehq/airbyte |
12,918 |
|
0 |
11 |
about 2 years ago |
311 |
December 08, 2023 |
5,111 |
other |
Python |
| The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted. |
| pachyderm/pachyderm |
6,035 |
|
0 |
1 |
about 2 years ago |
613 |
December 04, 2023 |
897 |
apache-2.0 |
Go |
| Data-Centric Pipelines and Data Versioning |
| GoogleCloudPlatform/DataflowJavaSDK |
853 |
|
249 |
14 |
over 5 years ago |
38 |
June 26, 2018 |
54 |
|
|
| Google Cloud Dataflow provides a simple, powerful model for building both batch and streaming parallel data processing pipelines. |
| jkrumbiegel/Chain.jl |
262 |
|
0 |
0 |
almost 4 years ago |
0 |
|
16 |
mit |
Julia |
| A Julia package for piping a value through a series of transformation expressions using a more convenient syntax than Julia's native piping functionality. |
| SETL-Framework/setl |
172 |
|
0 |
0 |
over 2 years ago |
4 |
August 21, 2020 |
5 |
apache-2.0 |
Scala |
| A simple Spark-powered ETL framework that just works 🍺 |
| dataplane-app/dataplane |
171 |
|
0 |
0 |
over 2 years ago |
33 |
August 30, 2024 |
35 |
other |
JavaScript |
| Dataplane is an Airflow inspired unified data platform with additional data mesh and RPA capability to automate, schedule and design data pipelines and workflows. Dataplane is written in Golang with a React front end. |
| codekitchen/pipeline |
169 |
|
0 |
0 |
over 5 years ago |
0 |
|
7 |
mit |
C |
| the `pipeline` shell command |
| datajoint/datajoint-python |
158 |
|
23 |
34 |
over 2 years ago |
71 |
July 31, 2025 |
143 |
lgpl-2.1 |
Python |
| Relational data pipelines for the science lab |
| AnicetNgrt/jiro-nn |
113 |
|
0 |
0 |
over 2 years ago |
6 |
July 04, 2023 |
0 |
|
Rust |
| A Deep Learning and preprocessing framework in Rust with support for CPU and GPU. |
| WinVector/data_algebra |
112 |
|
1 |
3 |
over 2 years ago |
91 |
September 29, 2023 |
2 |
bsd-3-clause |
Python |
| Codd method-chained SQL generator and Pandas data processing in Python. |
