Celery - Distributed Task Queue

  •        0

Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well. The execution units, called tasks, are executed concurrently on a single or more worker servers using multiprocessing, Eventlet, or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready).




comments powered by Disqus

Related Projects

RabbitMQ - Robust messaging for applications

RabbitMQ is a messaging broker - an intermediary for messaging. It gives your applications a common platform to send and receive messages, and your messages a safe place to live until received. It features include reliability, high availability, Clustering and Federation. RabbitMQ ships with an easy-to use management UI that allows you to monitor and control every aspect of your message broker. There are RabbitMQ clients for almost any language you can think of.

celery - Distributed Task Queue (development branch)

Distributed Task Queue (development branch)

kestrel - simple, distributed message queue system

simple, distributed message queue system

Fix8 - FIX (Financial Information eXchange Protocol) Framework

A fresh approach to FIX (Financial Information eXchange Protocol). Statically compile your FIX xml schema and quickly build your FIX application on top. With low latency performance in mind, this framework is designed to streamline the development of custom FIX interfaces. Using one of the standard FIX schemas you can have a FIX client or server up and running very quickly.

ZeroMQ - Messaging Library

The 0MQ lightweight messaging kernel is a library which extends the standard socket interfaces with features traditionally provided by specialised messaging middleware products. 0MQ sockets provide an abstraction of asynchronous message queues, multiple messaging patterns, message filtering (subscriptions), seamless access to multiple transport protocols and more.


Highly scalable/configurable Messaging Platform allowing users in a domain to be distributed on multiple hosts, has multiple queues. Provides virtual domains/users in MySQL. Modern MSP class qmail replacement with ESMTP, POP3/IMAP, QMTP, QMQP support

Sharq Server - A flexible rate limited queueing system

SHARQ is a flexible, open source, rate limited queuing system. Based on the Leaky Bucket Algorithm, SHARQ lets you create queues dynamically and update their rate limits in real time. SHARQ consists of two components - the core component and the server component. The SHARQ core is built on Redis, using Python and Lua, and the SHARQ Server is built using Flask and Gevent and talks HTTP.

Hornetq - Enterprise messaging

HornetQ is the new ultra high performance enterprise grade messaging system from JBoss community. It is a multi-protocol, embeddable, very high performance, clustered, asynchronous messaging system. It offers server replication and automatic client failover to eliminate lost or duplicated messages in case of server failure. It also provides a comprehensive management API to manage & monitor servers.

Gearman - Application Framework to farm out work to other Machines

Gearman provides a generic application framework to farm out work to other machines or processes that are better suited to do the work. It allows you to do work in parallel by doing load balancing. It also supports to call functions between languages. It is the nervous system for how distributed processing communicates. It is fault tolerant.


BinaryNotes is the Open Source ASN.1 (Abstract Syntax Notation One) framework for Java and .NET based on annotations/attributes. The framework has the flexible ASN.1 compiler, the runtime library that supports BER, DER and PER, and the Message Queues