384 best open source queue projects.

We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.

Displaying 1 to 20 from 384 results

delayed_job - Database backed asynchronous priority queue

Ruby

Delayed_job (or DJ) encapsulates the common pattern of asynchronously executing longer tasks in the background. It is a direct extraction from Shopify where the job table is responsible for a multitude of core tasks.

job-queue task job queue worker-queue background-task

Resque - Job queue in Ruby

Ruby

Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later. Queues are picked off in order of their priority. A job from a lower priority queue will only be picked off if there are no jobs for a higher priority queue available.

job-queue task job queue worker-queue background-task workflow

Chronicle-Queue - Micro second messaging that stores everything to disk

Java

Java library for persisted low latency messaging (Java 8+)

chronicle queue performance low-latency persistance

node_redis - redis client for node

Javascript

Redis client library

database redis transaction pipelining performance queue nodejs pubsub backpressure redis-client redis-driver redis-library

Buckets-JS - A complete, fully tested and documented data structure library written in pure JavaScript

Javascript

Buckets is a complete, fully tested and documented data structure library written in pure JavaScript.

data-structures collections collection linked-list dictionary map multimap stack queue set bag binary-heap priority-queue binary-search binary-search-tree tree tree-structure buckets data structure linked list heap priority binary data-structure hashmap

d3-queue - Evaluate asynchronous tasks with configurable concurrency.

Javascript

Evaluate asynchronous tasks with configurable concurrency.

d3 d3-module asynchronous async queue

Foundatio - Pluggable foundation blocks for building distributed apps.

CSharp

Pluggable foundation blocks for building loosely coupled distributed apps.Includes implementations in Redis, Azure, AWS and in memory (for development).

azure c-sharp lock message-bus storage redis metrics aws distributed-systems foundatio s3 jobs job-scheduler queue messaging statsd distributed-locks distributed logging abstractions

Sidekiq - Simple, efficient background processing for Ruby

Ruby

Simple, efficient background processing for Ruby. Sidekiq uses threads to handle many jobs at the same time in the same process. It does not require Rails but will integrate tightly with Rails 3/4 to make background processing dead simple. Sidekiq uses multithreading so it is much more memory efficient than Resque (which forks a new process for every job).

job-queue job task queue workflow worker worker-queue background-task

Fireworq - Lightweight, high-performance, language-independent job queue system

Fireworq is a lightweight, high-performance job queue system with the following abilities. It is available from ANY programming language which can talk HTTP. It works with a single binary without external dependencies. It is built on top of RDBMS (MySQL), so that jobs won't be lost even if the job queue process dies. You can apply an ordinary replication scheme to the underlying DB for the reliability of the DB itself.

job queue job-queue worker-queue background-task

rq - Simple job queues for Python

Python

RQ (Redis Queue) is a simple Python library for queueing jobs and processing them in the background with workers. It is backed by Redis and it is designed to have a low barrier to entry. It should be integrated in your web stack easily.RQ requires Redis >= 2.7.0.

queue message-queue task-queue messaging job-queue

disque - Disque is a distributed message broker

Disque is an ongoing experiment to build a distributed, in-memory, message broker. Its goal is to capture the essence of the "Redis as a jobs queue" use case, which is usually implemented using blocking list operations, and move it into an ad-hoc, self-contained, scalable, and fault tolerant design, with simple to understand properties and guarantees, but still resembling Redis in terms of simplicity, performance, and implementation as a C non-blocking networked server.Currently (2 Jan 2016) the project is in release candidate state. People are encouraged to start evaluating it and report bugs and experiences.

message-queue in-memory distributed message-broker queue

MassTransit - Distributed Application Framework for .NET

CSharp

MassTransit is a lightweight message bus for creating distributed applications using the .NET framework. MassTransit provides an extensive set of features on top existing message transports, resulting in a developer friendly way to asynchronously connect services using message-based conversation patterns. Message-based communication is a reliable and scalable way to implement a service oriented architecture.

rabbitmq gitter-chat appveyor azure-service-bus topshelf messaging nuget dotnet-core2 queue message-queue task-queue

javascript-datastructures-algorithms - :books: collection of JavaScript data structures and algorithms for education purposes

Javascript

Source code of Learning JavaScript Data Structures and Algorithms book.

javascript-algorithms algorithm data-structures typescript typescript-algorithms stack queue deque priority-queue linked-list set tree sorting-algorithms dictionary binary-tree avl-tree quicksort graph graph-algorithms dijkstra-algorithm

Celery - Distributed Task Queue

Python

Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well. The execution units, called tasks, are executed concurrently on a single or more worker servers using multiprocessing, Eventlet, or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready).

task-queue task queue worker distributed messaging message-queue job-queue task-manager task-scheduler task-runner sqs-queue

RabbitMQ - Robust messaging for applications

Erlang

RabbitMQ is a messaging broker - an intermediary for messaging. It gives your applications a common platform to send and receive messages, and your messages a safe place to live until received. It features include reliability, high availability, Clustering and Federation. RabbitMQ ships with an easy-to use management UI that allows you to monitor and control every aspect of your message broker. There are RabbitMQ clients for almost any language you can think of.

messaging message-queue task-queue queue asynchronous stomp

mnemonist - Curated collection of data structures for the JavaScript language.

Javascript

Mnemonist is a curated collection of data structures for the JavaScript language. It gathers classic data structures (think heap, trie etc.) as well as more exotic ones such as Buckhard-Keller trees etc.

data-structure bag bimap bit-array bit-set bit-vector bitset bk-tree burkhard-keller-tree circular-buffer counter data-structures disjoint-set fibonacci-heap fuzzy-map hashed-array-tree heap interval-tree inverted-index linked-list multimap multiset queue sparse-set stack structures suffix-tree symspell trie union-find vantage-point-tree vector vp-tree

yii2-queue - Yii2 Queue Extension. Supports DB, Redis, RabbitMQ, Beanstalk and Gearman

An extension for running tasks asynchronously via queues. It supports queues based on DB, Redis, RabbitMQ, AMQP, Beanstalk and Gearman.

yii2 queue redis amqp gearman async beanstalk rabbitmq

boltons - 🔩 Like builtins, but boltons

Python

boltons should be builtins. Full and extensive docs are available on Read The Docs. See what's new by checking the CHANGELOG.

utilities cache data-structures statistics data-science file queue json recursive

rsmq - Redis Simple Message Queue

CoffeeScript

A lightweight message queue for Node.js that requires no dedicated queue server. Just a Redis server. tl;dr: If you run a Redis server and currently use Amazon SQS or a similar message queue you might as well use this fast little replacement. Using a shared Redis server multiple Node.js processes can send / receive messages.

rsmq queue message-queue fifo redis nodejs npm messagequeue jobs