Big Queue - A big, fast and persistent queue based on memory mapped file.

•    Java

---

A big, fast and persistent queue based on memory mapped file.

queue java-collections collections data-structure memory-mapped

Redisson - Redis based In-Memory Data Grid for Java

•    Java

---

Redisson - distributed Java objects and services (Set, Multimap, SortedSet, Map, List, Queue, BlockingQueue, Deque, BlockingDeque, Semaphore, Lock, AtomicLong, Map Reduce, Publish / Subscribe, Bloom filter, Spring Cache, Executor service, Tomcat Session Manager, Scheduler service, JCache API) on top of Redis server. Rich Redis client.

cache distributed-caching distributed-locks redis-client redis-cluster collections java-collections hashmap set queue

goque - Persistent stacks and queues for Go backed by LevelDB

•    Go

---

Goque provides embedded, disk-based implementations of stack and queue data structures. Motivation for creating this project was the need for a persistent priority queue that remained performant while growing well beyond the available memory of a given machine. While there are many packages for Go offering queues, they all seem to be memory based and/or standalone solutions that are not embeddable within an application.

stack queue data-structure collections leveldb

Buckets-JS - A complete, fully tested and documented data structure library written in pure JavaScript

•    Javascript

---

Buckets is a complete, fully tested and documented data structure library written in pure JavaScript.

data-structures collections collection linked-list dictionary map multimap stack queue set bag binary-heap priority-queue binary-search binary-search-tree tree tree-structure buckets data structure linked list heap priority binary data-structure hashmap

JCTools - Java Concurrency Tools for the JVM

•    Java

---

Java Concurrency Tools for the JVM. This project aims to offer some concurrent data structures currently missing from the JDK.

concurrency data-structures queues lock-free wait-free awesome collections java-collection data-structure

typescript-collections - A generically typed set of collections for use with TypeScript

•    TypeScript

---

It is a complete, fully tested data structure library written in TypeScript. This project uses TypeScript Generics so you need TS 0.9 and above.

typescript generics data structures collections linked list dictionary default multi binary search tree key value stack queue set bag heap priority array

RocketMQ - Distributed messaging and streaming data platform

•    Java

---

Apache RocketMQ is a distributed messaging and streaming platform with low latency, high performance and reliability, trillion-level capacity and flexible scalability.

message-queue messaging queue pub-sub distributed

Faktory - "Takin' care of business, workin' overtime"

•    Go

---

At a high level, Faktory is a work server. It is the repository for background jobs within your application. Jobs have a type and a set of arguments and are placed into queues for workers to fetch and execute.You can use this server to distribute jobs to one or hundreds of machines. Jobs can be executed with any language by clients using the Faktory API to fetch a job from a queue.

message-queue job-queue task-queue background-task

queue - A persistent background job queue for iOS.

•    Objective-C

---

While NSOperation and NSOperationQueue work well for some repetitive problems and NSInvocation for others, iOS doesn't really include a set of tools for managing large collections of arbitrary background tasks easily. EDQueue provides a high-level interface for implementing a threaded job queue using GCD and SQLLite3. All you need to do is handle the jobs within the provided delegate method and EDQueue handles the rest. The easiest way to get going with EDQueue is to take a look at the included example application. The Xcode project file can be found in Project > queue.xcodeproj.

queue

Capsule - The Capsule Hash Trie Collections Library

•    Java

---

Capsule aims to become a full-fledged (immutable) collections library for Java 8+ that is solely built around persistent tries. The library is designed for standalone use and for being embedded in domain-specific languages. Capsule still has to undergo some incubation before it can ship as a well-rounded collection library. Nevertheless, the code is stable and performance is solid.

hashmap trie immutable immutable-collections persistent-data-structure hashset performance data-structure collections map list champ

Machinery - Asynchronous task queue/job queue based on distributed message passing

•    Go

---

Machinery is an asynchronous task queue/job queue based on distributed message passing.

task job-queue worker-queue task-scheduler queue amqp rabbitmq redis memcached mongodb message-queue

rsmq - Redis Simple Message Queue

•    CoffeeScript

---

A lightweight message queue for Node.js that requires no dedicated queue server. Just a Redis server. tl;dr: If you run a Redis server and currently use Amazon SQS or a similar message queue you might as well use this fast little replacement. Using a shared Redis server multiple Node.js processes can send / receive messages.

rsmq queue message-queue fifo redis nodejs npm messagequeue jobs

siberite - Siberite is a simple, lightweight, leveldb backed message queue written in Go.

•    Go

---

Siberite is a simple leveldb backed message queue server (twitter/kestrel, wavii/darner rewritten in Go). Siberite is a very simple message queue server. Unlike in-memory servers such as redis, Siberite is designed to handle queues much larger than what can be held in RAM. And unlike enterprise queue servers such as RabbitMQ, Siberite keeps all messages out of process, using goleveldb as a persistent storage.

queue message-queue kestrel darner

Celery - Distributed Task Queue

•    Python

---

Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well. The execution units, called tasks, are executed concurrently on a single or more worker servers using multiprocessing, Eventlet, or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready).

task-queue task queue worker distributed messaging message-queue job-queue task-manager task-scheduler task-runner sqs-queue

denque - The fastest javascript implementation of a double-ended queue

•    Javascript

---

Extremely fast and lightweight double-ended queue implementation with zero dependencies. Every queue operation is done at a constant O(1) - including random access from .peekAt(index).

data-structure data-structures queue double end ended deque denque double-ended-queue

Tibco Message Admin

•    

---

Tibco Message Admin allows you to purge a queue, list messages in a queue, save a message from a queue to a file, edit the message in memory and send to another (or same) queue, load message from a file and send it to a queue

Bee Queue - A simple, fast, robust job/task queue for Node.js, backed by Redis

•    Javascript

---

A simple, fast, robust job/task queue for Node.js, backed by Redis.Bee-Queue is meant to power a distributed worker pool and was built with short, real-time jobs in mind. A web server can enqueue a job, wait for a worker process to complete it, and return its results within an HTTP request. Scaling is as simple as running more workers.

redis-queue job-queue worker-queue job-scheduler bee-queue redis task job queue worker distributed system message-queue task-queue messaging

Sasa - Collection of Organized Extensions to the .NET framework.

•    CSharp

---

Sasa is a collection of extensions to the .NET framework organized in logical, often standalone assemblies. It supports functional collections, ie. list, dictionary, queue, set, etc, Statistical and numerical functions, MIME message parsing, POP3 client, Concurrent Revisions fork-join framework, type-safe reflection, Pratt parser and lot more.

collections pop3-client mime-parser mime pop3 reflection

tcpshm - A connection-oriented persistent message queue framework based on TCP or SHM(shared memory)

•    C++

---

When using TCP to transfer data, sent out messages are not guaranteed to be received or handled by the receiver, and even worse, we often get unexpected disconnections due to network issues or program crash, so efforts have been made on recovery procedure to ensure both sides are synced. TCPSHM provides a reliable and efficient solution based on a sequence number and acknowledge mechanism, that every sent out msg is persisted in a send queue until sender got ack that it's been consumed by the receiver, so that disconnects/crashes are tolerated and the recovery process is purely automatic. And as the name implies, shared memory is also supported when communicating on the same host, and it provides the same API and behavior as TCP(so whether TCP or SHM underlies the connection is transparent to the user), but it's more than 20 times faster than TCP on localhost(However TCP is still 3 times faster than ZeroMQ IPC, see Performance). The shared memory communication is based on A real-time single producer single consumer msg queue.

tcp message-queue shared-memory

Redpanda - A Kafka API compatible streaming platform for mission-critical workloads

•    C++

---

Redpanda is a streaming platform for mission critical workloads. It is Kafka API compatible so any client that works with Kafka should work out of the box with Redpanda. It does not have dependency on ZooKeeper, JVM. Redpanda is a new storage engine, optimized for streaming data, using a thread-per-core architecture focused on delivering stable tail-latencies. It transforms data inline with embedded WASM engine.

message-queue streaming kafka cpp containers realtime kubernetes queue kafka-protocol