NSQ - A realtime distributed messaging platform in Go

We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.

NSQ - A realtime distributed messaging platform in Go

NSQ is a realtime distributed messaging platform designed to operate at scale, handling billions of messages per day. It promotes distributed and decentralized topologies without single points of failure, enabling fault tolerance and high availability coupled with a reliable message delivery guarantee. It scales horizontally, without any centralized brokers. Built-in discovery simplifies the addition of nodes to the cluster.

support distributed topologies with no SPOF
horizontally scalable (no brokers, seamlessly add more nodes to the cluster)
low-latency push based message delivery
combination load-balanced and multicast style message routing
excel at both streaming (high-throughput) and job oriented (low-throughput) workloads
primarily in-memory (beyond a high-water mark messages are transparently kept on disk)
runtime discovery service for consumers to find producers
transport layer security (TLS)
data format agnostic
few dependencies (easy to deploy) and a sane, bounded, default configuration
simple TCP protocol supporting client libraries in any language
HTTP interface for stats, admin actions, and producers (no client library needed to publish)
integrates with statsd for realtime instrumentation
robust cluster administration interface

http://nsq.io/
https://github.com/nsqio/nsq

Tags	message-queue messaging distributed publish-subscribe pubsub queue
Implementation	Go
License	MIT
Platform	Windows Linux MacOS

Related Projects

Luxun - A high-throughput, persistent, distributed, publish-subscribe messaging system based on memo

Java

A high-throughput, persistent, distributed, publish-subscribe messaging system based on memory mapped file and Thrift RPC.

publish-subscribe message-queue pub-sub distributed thrift-rpc

Jafka - A fast and simple distributed publish-subscribe messaging system (mq)

Java

Jafka mq is a distributed publish-subscribe messaging system cloned from Apache Kafka.

publish-subscribe message-queue pub-sub distributed kafka-alternative kafka-clone

nsq - A realtime distributed messaging platform

* **Docs**: [http://nsq.io][docs] * **Twitter**: [@nsqio][nsqio_twitter][![Build Status](https://secure.travis-ci.org/bitly/nsq.svg?branch=master)](http://travis-ci.org/bitly/nsq)**NSQ** is a realtime distributed messaging platform designed to operate at scale, handlingbillions of messages per day.It promotes *distributed* and *decentralized* topologies without single points of failure,enabling fault tolerance and high availability coupled with a reliable message deliveryguarantee. See [featur

liftbridge - Lightweight, fault-tolerant message streams.

Liftbridge provides lightweight, fault-tolerant message streams by implementing a durable stream augmentation for the NATS messaging system. It extends NATS with a Kafka-like publish-subscribe log API that is highly available and horizontally scalable. Use Liftbridge as a simpler and lighter alternative to systems like Kafka and Pulsar or use it to add streaming semantics to an existing NATS deployment. See the introduction post on Liftbridge and this post for more context and some of the inspiration behind it.

nats streaming messaging cloud-native grpc distributed-systems liftbridge message-queue pubsub

hemera - 🔬 Writing reliable & fault-tolerant microservices with https://nats.io

Javascript

Hemera (/ˈhɛmərə/; Ancient Greek: Ἡμέρα [hɛːméra] "day") is a small wrapper around the NATS driver. NATS is a simple, fast and reliable solution for the internal communication of a distributed system. It chooses simplicity and reliability over guaranteed delivery. We want to provide a toolkit to develop micro services in an easy and powerful way. We provide a pattern matching RPC style. You don't have to worry about the transport. NATS is powerful.Hemera has not been designed for high performance on a single process. It has been designed to create lots of microservices doesn't matter where they live. It choose simplicity and reliability as primary goals. It act together with NATS as central nervous system of your distributed system. Transport independency was not considered to be a relevant factor. In addition we use pattern matching which is very powerful. The fact that Hemera needs a broker is an argument which should be taken into consideration when you compare hemera with other frameworks. The relevant difference between microservice frameworks like senecajs, molecurer is not the performance or modularity its about the complexity you need to manage. Hemera is expert in providing an interface to work with lots of services in the network, NATS is the expert to deliver the message at the right place. Hemera is still a subscriber of NATS with some magic in routing and extensions. We don't have to worry about all different aspects in a distributed system like routing, load-balancing, service-discovery, clustering, health-checks ...

nodejs distributed-systems microservice nats pubsub rpc cloud-native micro service micro-service microservices micro-services services framework minimum viable product toolkit startup messaging publish subscribe queue distributed queueing

emitter - High performance, distributed and low latency publish-subscribe platform.

Emitter is a free open source real-time messaging service that connects all devices. This publish-subscribe messaging API is built for speed and security. Emitter is a real-time communication service for connecting online devices. Infrastructure and APIs for IoT, gaming, apps and real-time web. At its core, emitter.io is a distributed, scalable and fault-tolerant publish-subscribe messaging platform based on MQTT protocol and featuring message storage.

pubsub networking emitter mqtt mqtt-broker realtime high-performance low-latency

RocketMQ - Distributed messaging and streaming data platform

Java

Apache RocketMQ is a distributed messaging and streaming platform with low latency, high performance and reliability, trillion-level capacity and flexible scalability.

message-queue messaging queue pub-sub distributed

gnatsd - High-Performance server for NATS, the cloud native messaging system.

NATS Server is a simple, high performance open source messaging system for cloud native applications, IoT messaging, and microservices architectures. It implements a highly scalable and elegant publish-subscribe (pub/sub) distribution model. The performant nature of NATS make it an ideal base for building modern, reliable, scalable cloud native distributed systems.

messaging message-bus message-queue cloud-native microservices-architecture nats-server distributed-systems cloud cloud-computing

node-nats - Node.js client for NATS, the cloud native messaging system.

Javascript

A Node.js client for the NATS messaging system.See examples and benchmarks for more information..

nats messaging pubsub publish subscribe queue distributed queueing

nats.js - Node.js client for NATS, the cloud native messaging system.

Javascript

A Node.js client for the NATS messaging system. The json connect property makes it easier to exchange JSON data with other clients.

nats messaging pubsub publish subscribe queue distributed queueing

Faye - Simple pub/sub messaging for the web

Javascript

Faye is a set of tools for simple publish-subscribe messaging between web clients. It ships with easy-to-use message routing servers for Node.js and Rack applications, and clients that can be used on the server and in the browser. It is based on the Bayeux protocol.

pub-sub messaging message-queue publish-subscribe bayeux

huststore - High-performance Distributed Storage

huststore is a open source high performance distributed database system. It not only provides key-value storage service with extremely high performance, up to 100 thousand QPS, but also supports data structures like hash, set, sorted set, etc. Also, it can store binary data as value from a key-value pair, and thus can be used as an alternative of Redis.In addtion, huststore implements a distributed message queue by integrating a special HA module, features including message Push Stream, and message Publish-SubScribe, these features can be used as replacements of the corresponding features in rabbitmq and gearman.

architecture benchmark redis database-engine nginx message-queue distributed-storage

Apache Apollo - ActiveMQ's next generation of messaging

Java

ActiveMQ Apollo is a faster, more reliable, easier to maintain messaging broker built from the foundations of the original ActiveMQ. It accomplishes this using a radically different threading and message dispatching architecture. Like ActiveMQ, Apollo is a multi-protocol broker and supports STOMP, AMQP, MQTT, Openwire, SSL, and WebSockets.

messaging message-queue queue publish-subscribe pub-sub mqtt stomp amqp

Redisson - Redis based In-Memory Data Grid for Java

Java

Redisson - distributed Java objects and services (Set, Multimap, SortedSet, Map, List, Queue, BlockingQueue, Deque, BlockingDeque, Semaphore, Lock, AtomicLong, Map Reduce, Publish / Subscribe, Bloom filter, Spring Cache, Executor service, Tomcat Session Manager, Scheduler service, JCache API) on top of Redis server. Rich Redis client.

cache distributed-caching distributed-locks redis-client redis-cluster collections java-collections hashmap set queue

Aeron - Efficient reliable unicast and multicast transport protocol

Java

Aeron is an efficient reliable unicast and multicast transport protocol. The Aeron protocol is designed to be run directly over many different types of transmission media, including shared memory/IPC, InfiniBand/RDMA, UDP, TCP, Raw IP, HTTP, WebSocket, BLE, etc.

unicast multicast tcp udp messaging ipc publish-subscribe pubsub message-queue

Celery - Distributed Task Queue

Python

Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well. The execution units, called tasks, are executed concurrently on a single or more worker servers using multiprocessing, Eventlet, or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready).

task-queue task queue worker distributed messaging message-queue job-queue task-manager task-scheduler task-runner sqs-queue

MBassador - Light-weight, high-performance event bus implementing the publish subscribe pattern

Java

MBassador is a light-weight, high-performance event bus implementing the publish subscribe pattern. It is designed for ease of use and aims to be feature rich and extensible while preserving resource efficiency and performance. The core of MBassador is built around a custom data structure that provides non-blocking reads and minimized lock contention for writes such that performance degradation of concurrent read/write access is minimal.

event-bus messaging message-queue pub-sub publish-subscribe

Pulsar - Distributed pub-sub Messaging System from Yahoo

Java

Pulsar is a distributed pub-sub messaging platform with a very flexible messaging model and an intuitive client API. It is horizontally scalable (Millions of independent topics and millions of messages published per second), Strong ordering and consistency guarantees, Low latency , REST API, Geo Replication and lot more.

messaging message-queue task-queue queue distributed pub-sub

Bee Queue - A simple, fast, robust job/task queue for Node.js, backed by Redis

Javascript

A simple, fast, robust job/task queue for Node.js, backed by Redis.Bee-Queue is meant to power a distributed worker pool and was built with short, real-time jobs in mind. A web server can enqueue a job, wait for a worker process to complete it, and return its results within an HTTP request. Scaling is as simple as running more workers.

redis-queue job-queue worker-queue job-scheduler bee-queue redis task job queue worker distributed system message-queue task-queue messaging

enqueue-dev - PHP7.1+. Message queue packages for PHP, Symfony, Laravel, Yii, and Magento

Enqueue is production ready, battle-tested messaging solution for PHP. Provides a common way for programs to create, send, read messages. This is a main development repository. It provides a friendly environment for productive development and testing of all Enqueue related features&packages.