gen-batch-server - A generic batching server for Erlang and Elixir

  •        3

gen_batch_server is a stateful generic server similar to gen_server that instead of processing incoming requests one by one gathers them into batches before they are passed to the behaviour implementation. Batches are processed either when the Erlang process mailbox has no further messages to batch or when the number of messages in the current batch reaches the maximum batch size limit. gen_batch_server tries to trade latency for throughput by automatically growing the max batch size limit when message ingress is high and shrinks it down again as ingress reduces.

https://github.com/rabbitmq/gen-batch-server

Tags
Implementation
License
Platform

   




Related Projects

the-little-elixir-otp-guidebook-code - Code examples for The Little Elixir & OTP Guidebook

  •    Elixir

Welcome! This is the source code for "The Little Elixir & OTP Guidebook". These larger programs will contain their own READMEs and more detailed instructions on running the program.

spring-batch - Spring Batch is a framework for writing offline and batch applications using Spring and Java

  •    Java

Spring Batch is a lightweight, comprehensive batch framework designed to enable the development of robust batch applications vital for the daily operations of enterprise systems. Spring Batch builds upon the productivity, POJO-based development approach, and general ease of use capabilities people have come to know from the Spring Framework, while making it easy for developers to access and leverage more advanced enterprise services when necessary.If you are looking for a runtime container for your Batch applications, or need a management console to view current and historic executions, take a look at Spring Batch Admin. It is a set of services (Java, JSON, JMX) and an optional web UI that you can use to manage and monitor a Batch system.

Batch Sync Report

  •    Perl

Batch Sync Report is a Perl script to generate HTML reports regarding Batch Sync facility from Siebel 7. Batch Sync Report will report about how many users successfuly extracted a database, giving summary and detailed information per server and per user

Batch File OS (Windows hosting)

  •    

*BATCH FILE OS* Batch File OS is possibly the first-ever platform-based OS created in the MS-DOS Batch language. Scripting language: * MS-DOS Batch Other languages are welcome in this project, as long as they can be integrated in the Batch script.


Enterprise Batch Server

  •    

Enterprise Batch Server will fulfill the needs of an enterprise by providing the powerful framework to develop batch applications and provide the tools to schedule, manage and monitor those applications.

manifold - Fast batch message passing between nodes for Erlang/Elixir.

  •    Elixir

Erlang and Elixir make it very easy to send messages between processes even across the network, but there are a few pitfalls. Inspired by a blog post about boosting performance of message passing between nodes, Manifold was born. Manifold distributes the work of sending messages to the remote nodes of the PIDs, which guarantees that the sending processes at most only calls send/2 equal to the number of involved remote nodes. Manifold does this by first grouping PIDs by their remote node and then sending to Manifold.Partitioner on each of those nodes. The partitioner then consistently hashes the PIDs using :erlang.phash2/2, groups them by number of cores, sends to child workers, and finally those workers send to the actual PIDs. This ensures the partitioner does not get overloaded and still provides the linearizability guaranteed by send/2.

Simple Batch

  •    

Project Description This is a simple batch framework allowing you to define batch jobs in a basic XML format. Contains a basic selection of built-in actions (data processors) such as the following; File (Text, CSV, XML) Email SQL (SQL Server Client) SharePoint (Docum...

MapPoint Batch Geocoder

  •    

The MapPoint Batch Geocoder is an open source transformation component for SQL Server Integration Services that performs batch geocoding of address information directly within the SSIS pipeline using the geocoding capabilities of MapPoint's Customer Data Services. The transfor...

react-relay-network-layer - ReactRelayNetworkLayer with middlewares and query batching for Relay Classic

  •    Javascript

The ReactRelayNetworkLayer is a Relay Network Layer with various middlewares which can manipulate requests/responses on the fly (change auth headers, request url or perform some fallback if request fails), batch several relay request by timeout into one http request. ReactRelayNetworkLayer can be used in browser, react-native or node server for rendering. Under the hood this module uses global fetch method. So if your client is too old, please import explicitly proper polyfill to your code (eg. whatwg-fetch, node-fetch or fetch-everywhere).

ElixirBooks - List of Elixir books

  •    

Official Elixir starting guide that will take you through the language foundations. You will also explore how to build projects with Mix and OTP, and it will introduce you to more advanvced techniques suchs as meta-programming. Adoption is more than programming. Elixir is an exciting new language, but to successfully get your application from start to finish, you’re going to need to know more than just the language. You need the case studies and strategies in this book. Learn the best practices for the whole life of your application, from design and team-building, to managing stakeholders, to deployment and monitoring. Go beyond the syntax and the tools to learn the techniques you need to develop your Elixir application from concept to production.

Java Batch System

  •    Java

The Java Batch System (JBS) is a batch queueing system in the tradition of NQS and PBS for internal (Java-based) and system batch jobs. Stand-alone operation and integration with existing batch queueing systems, initially OpenPBS, is supported.

que - Simple Job Processing in Elixir with Mnesia :zap:

  •    Elixir

Que is a job processing library backed by Mnesia, a distributed real-time database that comes with Erlang / Elixir. That means it doesn't depend on any external services like Redis for persisting job state. This makes it really easy to use since you don't need to install anything other than Que itself. See the Documentation.

SharePoint 2010 Batch Edit

  •    

Bulk & Batch updating list & document properties in SharePoint 2010. This ribbon custom action makes it possible to update multiple items with Managed Metadata properties, Enterprise Keywords, people picker, and many more.

spring-batch-admin - Spring Batch Admin: runtime application and utilities for running Jobs with Spring Batch

  •    Java

A set of services (Java, JSON) and a UI (webapp) for managing and launching Spring Batch jobs.

Java Batch Job Framework

  •    Java

Java Batch Job Framework. The JBJF uses an XML definition file to abstract many of your common batch job parameters. The JBJF programming framework uses a task list concept as a divide and conquer strategy to simplify your batch job development.

batch_api - A Facebook-style, RESTful Batch API

  •    Ruby

A gem that provides a RESTful Batch API for Rails and other Rack applications. In this system, batch requests are simply collections of regular REST calls, whose results are returned as an equivalent collection of regular REST results. This is heavily inspired by Facebook's Batch API.

udocker - A basic user tool to execute simple docker containers in batch or interactive systems without root privileges

  •    Python

A basic user tool to execute simple docker containers in user space without requiring root privileges. Enables download and execution of docker containers by non-privileged users in Linux systems where docker is not available. It can be used to pull and execute docker containers in Linux batch systems and interactive clusters that are managed by other entities such as grid infrastructures or externally managed batch or interactive systems. The INDIGO udocker does not require any type of privileges nor the deployment of services by system administrators. It can be downloaded and executed entirely by the end user.

cnn-models - ImageNet pre-trained models with batch normalization for the Caffe framework

  •    Python

This repository contains convolutional neural network (CNN) models trained on ImageNet by Marcel Simon at the Computer Vision Group Jena (CVGJ) using the Caffe framework as published in the accompanying technical report. Each model is in a separate subfolder and contains everything needed to reproduce the results. This repository focuses currently contains the batch-normalization-variants of AlexNet and VGG19 as well as the training code for Residual Networks (Resnet). No mean subtraction is required for the pre-trained models! We have a batch-normalization layer which basically does the same.

amqp - Idiomatic Elixir client for RabbitMQ

  •    Elixir

Simple Elixir wrapper for the Erlang RabbitMQ client. The API is based on Langohr, a Clojure client for RabbitMQ.