Vert.x - Tool-kit for building reactive applications on the JVM

•    Java

---

Vert.x is a tool-kit for building reactive applications on the JVM. Vert.x is event driven and non blocking. This means your app can handle a lot of concurrency using a small number of kernel threads. Vert.x lets your app scale with minimal hardware.Vert.x is incredibly flexible - whether it's simple network utilities, sophisticated modern web applications, HTTP/REST microservices, high volume event processing or a full blown back-end message-bus application.

reactive reactive-programming asynchronous events async streaming

logstash - Logstash - transport and process your logs, events, or other data

•    Ruby

---

Logstash is part of the Elastic Stack along with Beats, Elasticsearch and Kibana. Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to your favorite "stash." (Ours is Elasticsearch, naturally.). Logstash has over 200 plugins, and you can write your own very easily as well.The license is Apache 2.0, meaning you are pretty much free to use it however you want in whatever way.

etl-framework streaming logging jruby real-time-processing devops-tools devops

marko - A friendly (and fast!) UI library from eBay that makes building web apps fun

•    Javascript

---

UI Components + streaming, async, high performance, HTML templating for Node.js and the browser.

ui-components dom vdom nodejs server-side-rendering client-side-rendering isomorphic front-end templating template async streaming components ui morphdom virtual virtual-dom template-engine

Kaltura - Video Platform

•    PHP

---

Kaltura enables video management, publishing, syndication and monetization, as well as providing a robust framework for managing rich-media applications, and developing a variety of online workflows for video. Publishers could host their video content in their own data center. Web developers could use this software to to provide video management and delivery solutions to the web sites.

video-platform video streaming video-cms

onyx - Distributed, masterless, high performance, fault tolerant data processing

•    Clojure

---

Changelog can be found at changes.md.A searchable set of documentation for the Onyx data model is available.

distributed streaming batch data

JSONStream - rawStream.pipe(JSONStream.parse()).pipe(streamOfObjects)

•    Javascript

---

The .. operator is the recursive descent operator from JSONPath, which will match a child at any depth (see examples below).If your keys have keys that include . or * etc, use an array instead. ['row', true, /^doc/].

json stream streaming parser async parsing

primus - :zap: Primus, the creator god of the transformers & an abstraction layer for real-time to prevent module lock-in

•    Javascript

---

Primus, the creator god of transformers but now also known as universal wrapper for real-time frameworks. There are a lot of real-time frameworks available for Node.js and they all have different opinions on how real-time should be done. Primus provides a common low level interface to communicate in real-time using various real-time frameworks.If you deploy your application behind a reverse proxy (Nginx, HAProxy, etc.) you might need to add WebSocket specific settings to its configuration files. If you intend to use WebSockets, please ensure that these settings have been added. There are some example configuration files available in the observing/balancerbattle repository.

real-time websocket framework sockjs browserchannel polling http nodejs node abstraction engine.io comet streaming pubsub pub sub ajax xhr faye io primus prumus realtime socket socket.io sockets spark transformer transformers websockets ws uws

Aerial - Aerial Apple TV screen saver for Windows

•    CSharp

---

Aerial is a Windows screen saver based on the new Apple TV screen saver that displays the aerial movies Apple shot over New York, San Francisco, Hawaii, China, etc. Aerial for Windows is based on the Mac Aerial Screen Saver by John Coates.

screensaver apple video streaming aerial aerials apple-tv

Twitter4j - Twitter Java Library

•    Java

---

Twitter4J is an open-sourced, mavenized and Google App Engine safe Java library for the Twitter API which is released under the APL 2.0.

twitter twitter-api twitter-library streaming

Jackson JSON - JSON Parser in Java

•    Java

---

Jackson is a multi-purpose Java library for processing JSON data format. This project contains core low-level incremental ("streaming") parser and generator abstractions used by Jackson Data Processor. It also includes the default implementation of handler types (parser, generator) that handle JSON format.

json json-parser java-json json-generator streaming

HaishinKit.swift - Camera and Microphone streaming library via RTMP, HLS for iOS, macOS, tvOS.

•    Swift

---

Please set up your project Swift 4.0. Make sure you setup and activate your AVAudioSession.

rtmp hls streaming camera aac h264

ExoPlayer - Media Player for Android

•    Java

---

ExoPlayer is an application level media player for Android. It provides an alternative to Android’s MediaPlayer API for playing audio and video both locally and over the internet. ExoPlayer supports features not currently supported by Android’s MediaPlayer API (as of KitKat), including DASH and SmoothStreaming adaptive playbacks, persistent caching and custom renderers.

media-player mediaplayer player streaming video-streaming

lua-resty-http - Lua HTTP client cosocket driver for OpenResty / ngx_lua.

•    Lua

---

Lua HTTP client cosocket driver for OpenResty / ngx_lua. Production ready.

openresty http-client nginx nginx-lua luajit streaming http

smart_open - Utils for streaming large files (S3, HDFS, gzip, bz2...)

•    Python

---

There are a few optional keyword arguments that are useful only for S3 access. These are both passed to boto.s3_connect() as keyword arguments. The S3 reader supports gzipped content, as long as the key is obviously a gzipped file (e.g. ends with ".gz").

s3 hdfs webhdfs boto streaming file streaming-data gzip-stream bz2

FFmpeg - Mirror of git://source.ffmpeg.org/ffmpeg.git

•    C

---

FFmpeg is a collection of libraries and tools to process multimedia content such as audio, video, subtitles and related metadata. The offline documentation is available in the doc/ directory.

ffmpeg video audio mpeg webm mp4 matroska hls rtsp rtmp hevc fft multimedia streaming

gulp - The streaming build system

•    Javascript

---

This file will give you a taste of what gulp does. Node already supports a lot of ES2015, to avoid compatibility problem we suggest to install Babel and rename your gulpfile.js as gulpfile.babel.js.

build stream system make tool asset pipeline series parallel streaming

CacheP2P - "More users = More capacity"

•    Javascript

---

CacheP2P is a highly distributed cache platform based on WebTorrent and runs only in the browser. It is a javascript library that once included in a website, makes every new user a mirror of the specific URL he has opened and allows it to serve it to all the other users that also are accessing the same website, so the website's server doesn't have to.

cache p2p distributed webtorrent web2web cachep2p p2pcache web2webcache cacheweb2web bittorrent bittorrent-client download mad-science peer-to-peer peers streaming swarm torrent web-torrent webrtc webrtc-data

node-csv - Full featured CSV parser with simple api and tested against large datasets.

•    Javascript

---

This project provides CSV generation, parsing, transformation and serialization for Node.js. It has been tested and used by a large community over the years and should be considered reliable. It provides every option you would expect from an advanced CSV parser and stringifier.

csv parser nodejs streaming node tsv parse stringifier stringify

jocko - Kafka implemented in Golang with built-in coordination (No ZK dep, single binary install, Cloud Native)

•    Go

---

Kafka/distributed commit log service in Go. docker build -t travisjeffery/jocko:latest .

kafka distributed-systems queue messaging streaming

Akka HTTP - The Streaming-first HTTP server/module of Akka

•    Scala

---

The Akka HTTP modules implement a full server- and client-side HTTP stack on top of akka-actor and akka-stream. It's not a web-framework but rather a more general toolkit for providing and consuming HTTP-based services. While interaction with a browser is of course also in scope it is not the primary focus of Akka HTTP.

akka akka-http http http-server http-client streaming reactive http2 websocket asynchronous