Storm - Distributed and fault-tolerant realtime computation

  •        0

Storm is a distributed real time computation system. Storm makes it easy to reliably process unbounded streams of data, doing for real time processing what Hadoop did for batch processing. Storm has many use cases: realtime analytics, online machine learning, continuous computation, distributed RPC, ETL, and more.

Storm integrates with the queueing and database technologies you already use. A Storm topology consumes streams of data and processes those streams in arbitrarily complex ways, repartitioning the streams between each stage of the computation however needed.



comments powered by Disqus

Related Projects

Live Graph - Plot and explore your data in real-time

LiveGraph is a framework for real-time data visualisation, analysis and logging. It has a real time plotter that can automatically update graphs of your data while it is still being computed by your application. LiveGraph reads files in a simple CSV-style format. For applications developed in Java, LiveGraph additionally provides an API that handles all data logging and persistency issues.


Distributed and fault-tolerant realtime computation: stream processing, continuous computation, distributed RPC, and more

hummingbird - Real time web analytics using node.js and web sockets

Real time web analytics using node.js and web sockets

Skype Voice Changer

Skype Voice Changer demonstrates how to use NAudio and Skype4COM to allow real-time effects processing of your voice during a Skype conversation. It is developed in C#.

Open Web Analytics - Analytics used by Wikimedia

Open Web Analytics is open source web analytics software that you can use to track and analyze how people use your web sites and applications. OWA provides web site owners and developers with easy ways to add web analytics to their sites using simple Javascript, PHP, or REST based APIs. OWA also comes with built-in support for tracking web sites made with popular content management frameworks such as WordPress and MediaWiki.

Jackson JSON - JSON Parser in Java

Jackson is a multi-purpose Java library for processing JSON data format. This project contains core low-level incremental ("streaming") parser and generator abstractions used by Jackson Data Processor. It also includes the default implementation of handler types (parser, generator) that handle JSON format.

OpenCV - Open Source Computer Vision

OpenCV (Open Source Computer Vision) is a library of programming functions for real time computer vision. The library has more than 500 optimized algorithms. It is used to interactive art, to mine inspection, stitching maps on the web on through advanced robotics.


MidiShare is a real-time musical MIDI operating system. Result of many years of research and development undertaken by Computer Music Research Laboratory of Grame, MidiShare provides high level services to the field of computer music and MIDI applications

ZeroC - Internet Communications Engine

The Internet Communications Engine (Ice) is a modern object-oriented middleware with support for C++, .NET, Java, Python, Objective-C, Ruby, and PHP. Its latest release has support for Android and .NET Framework. It helps to build distributed applications easier as it takes care of all interactions with low-level network programming interfaces. It supports cross-language and cross-platform communication.

Scribe - Real time log aggregation used in Facebook

Scribe is a server for aggregating log data that's streamed in real time from clients. It is designed to be scalable and reliable. It is developed and maintained by Facebook. It is designed to scale to a very large number of nodes and be robust to network and node failures. There is a scribe server running on every node in the system, configured to aggregate messages and send them to a central scribe server (or servers) in larger groups.

Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.

Tag Cloud >>