Easy S3 Kafka Consumer Alternatives

Pain-free system for sinking data from kafka to s3. Written in Go for high concurrency. Great for streaming large amounts of web data into s3 for use with mapreduce.
Suggest Alternative
Alternatives To pvnick/easy-s3-kafka-consumer
Project Name Stars Downloads Repos Using This Packages Using This Most Recent Commit Total Releases Latest Release Open Issues License Language
twitter/summingbird 2,117 1 13 about 4 years ago 36 June 23, 2016 163 apache-2.0 Scala
Streaming MapReduce with Scalding and Storm
microsoft/Mobius 940 6 0 over 3 years ago 22 January 29, 2017 88 mit C#
C# and F# language binding and extensions to Apache Spark
hackreduce/Hackathon 114 0 0 over 8 years ago 0 1 mit Java
Library and resources for hack/reduce Hackathon events
asuiu/pyxtension 36 0 2 over 2 years ago 54 November 05, 2023 8 mit Python
Pure Python extensions library that includes Scala-like streams, Json with attribute access syntax, and other common use stuff
paulgb/haskell_hadoop 34 0 0 over 12 years ago 0 0 zlib Haskell
Haskell module for streaming hadoop MapReduce jobs
jiuxiantuan/mossrose 32 2 3 almost 8 years ago 35 June 15, 2018 0 Java
Light Distributed Job Framework
whitfin/efflux 31 0 0 almost 3 years ago 7 January 15, 2019 1 mit Rust
Easy Hadoop Streaming and MapReduce interfaces in Rust
echen/rosetta-scone 25 0 0 almost 14 years ago 0 1 Ruby
A collection of MapReduce tasks translated (from Pig, Hive, MapReduce streaming, Cascalog, etc.) into Scalding.
Sotera/zephyr 21 0 0 about 10 years ago 0 3 apache-2.0 Java
Zephyr is a big data, platform agnostic ETL API, with Hadoop MapReduce, Storm, and other big data bindings.
hiejulia/Data-pipeline-project 18 0 0 over 3 years ago 0 0 Jupyter Notebook
Data pipeline project
Alternatives To pvnick/easy-s3-kafka-consumer
Select To Compare


Alternative Project Comparisons
Popular Mapreduce Projects
Popular Streaming Projects
Popular Data Processing Categories
Related Searches
Get A Weekly Email With Trending Projects
No Spam. Unsubscribe easily at any time.
Privacy | About | Terms | Follow Us On Twitter

Downloads, Dependent Repos, Dependent Packages, Total Releases, Latest Releases data powered by Libraries.io.

Copyright 2018-2026 Awesome Open Source.  All rights reserved.