Gearman - Application Framework to farm out work to other Machines

  •        1959

Gearman provides a generic application framework to farm out work to other machines or processes that are better suited to do the work. It allows you to do work in parallel by doing load balancing. It also supports to call functions between languages. It is the nervous system for how distributed processing communicates. It is fault tolerant.

A Gearman powered application consists of three parts: a client, a worker, and a job server. The client is responsible for creating a job to be run and sending it to a job server. The job server will find a suitable worker that can run the job and forwards the job on. The worker performs the work requested by the client and sends a response to the client through the job server.

http://gearman.org/

Tags
Implementation
License
Platform

   




Related Projects

NSQ - A realtime distributed messaging platform in Go


NSQ is a realtime distributed messaging platform designed to operate at scale, handling billions of messages per day. It promotes distributed and decentralized topologies without single points of failure, enabling fault tolerance and high availability coupled with a reliable message delivery guarantee. It scales horizontally, without any centralized brokers. Built-in discovery simplifies the addition of nodes to the cluster.

Celery - Distributed Task Queue


Celery is an asynchronous task queue/job queue based on distributed message passing. It is focused on real-time operation, but supports scheduling as well. The execution units, called tasks, are executed concurrently on a single or more worker servers using multiprocessing, Eventlet, or gevent. Tasks can execute asynchronously (in the background) or synchronously (wait until ready).

machinery - Machinery is an asynchronous task queue/job queue based on distributed message passing.


Machinery is an asynchronous task queue/job queue based on distributed message passing.First, you will need to define some tasks. Look at sample tasks in example/tasks/tasks.go to see a few examples.

Resque - Job queue in Ruby


Resque is a Redis-backed Ruby library for creating background jobs, placing them on multiple queues, and processing them later. Queues are picked off in order of their priority. A job from a lower priority queue will only be picked off if there are no jobs for a higher priority queue available.

cloudist - Cloudist is a simple, highly scalable job queue for Ruby applications


Cloudist is a simple, highly scalable job queue for Ruby applications



Pyres - Job queue in Python


Pyres is a Resque clone. Resque is a great implementation of a job queue by the people at github.

tee - An all-clojure parallel and distributed job queue


An all-clojure parallel and distributed job queue

django-greenqueue - Asynchronous task task/job queue based on distributed message passing.


Asynchronous task task/job queue based on distributed message passing.

RocketMQ - Distributed messaging and streaming data platform


Apache RocketMQ is a distributed messaging and streaming platform with low latency, high performance and reliability, trillion-level capacity and flexible scalability.

Jesque - Job queue in Java


Jesque is an implementation of Resque in Java. It is fully-interoperable with the Ruby and Node.js (Coffee-Resque) implementations.

delayed_job - Database backed asynchronous priority queue


Delayed_job (or DJ) encapsulates the common pattern of asynchronously executing longer tasks in the background. It is a direct extraction from Shopify where the job table is responsible for a multitude of core tasks.

Zend - PHP application stack


Zend Server is a complete, enterprise-ready Web Application Server for running and managing PHP applications that require a high level of reliability, performance and security. It boosts application performane using byte code optimizer. It provides application stack for PHP application. It also provide support to connect to Java applications.

cherami-server - Distributed, scalable, durable, and highly available message queue system.


Cherami is a distributed, scalable, durable, and highly available message queue system we developed at Uber Engineering to transport asynchronous tasks.This repo contains the source code of Cherami server, cross-zone replicator server, and several tools. Your application needs to use the client to interact with the server. The client can be found here.

Redisson - Redis based In-Memory Data Grid for Java


Redisson - distributed Java objects and services (Set, Multimap, SortedSet, Map, List, Queue, BlockingQueue, Deque, BlockingDeque, Semaphore, Lock, AtomicLong, Map Reduce, Publish / Subscribe, Bloom filter, Spring Cache, Executor service, Tomcat Session Manager, Scheduler service, JCache API) on top of Redis server. Rich Redis client.

dgrid-server - Server for the dgrid job queue and lightweight MapReduce client


Server for the dgrid job queue and lightweight MapReduce client

leeloo - Job queue server


Job queue server

qserve - job queue server used in mwlib


job queue server used in mwlib

kongnomal - beanstalk server wrapper that allows event handler registration on job event queue


beanstalk server wrapper that allows event handler registration on job event queue

rjqueue - Job Queue UDP Server


Job Queue UDP Server