Gizmo - A Microservice Toolkit from The New York Times

•    Go

---

Gizmo Microservice Toolkit toolkit provides packages to put together server and pubsub daemons with the following features like Standardized configuration and logging, Health check endpoints with configurable strategies, Configuration for managing pprof endpoints and log levels, Structured logging containing basic request information, Useful metrics for endpoints, Graceful shutdowns, Basic interfaces to define our expectations and vocabulary and lot more.

http-server pubsub google-pubsub sns sqs kafka gizmo web-framework go-web-framework framework

aws-lib - Extensible Node.js library for the Amazon Web Services API

•    Javascript

---

A simple Node.js library to communicate with the Amazon Web Services API. Richard Rodger maintains a user-friendly SimpleDB library which is based on aws-lib.

amazon aws ec2 product-advertising simpledb simple-queue-service sqs simple-email-service ses auto-scaling as

sqs-consumer - Build SQS-based Node applications without the boilerplate

•    Javascript

---

Build SQS-based applications without the boilerplate. Just define a function that receives an SQS message and call a callback when the message has been processed.Creates a new SQS consumer.

sqs polling aws queue consumer

thumbd - Node.js/AWS/ImageMagick-based image thumbnailing service.

•    Javascript

---

Thumbd is an image thumbnailing server built on top of Node.js, SQS, S3, and ImageMagick.You can easily run Thumbd on Heroku. Simply set the appropriate environment variables with config:set and deploy using the Procfile provided.

image imagemagick processing sqs thumbnail thumbnail-service

Kombu - Messaging Framework for Python

•    Python

---

Kombu is a Messaging Framework for Python. The aim of Kombu is to make messaging in Python as easy as possible by providing an idiomatic high-level interface for the AMQ protocol, and also provide proven and tested solutions to common messaging problems.

celery messaging message-queue kombu python-library rabbitmq sqs

aws4 - Signs and prepares node.js (and browser) requests using AWS Signature Version 4

•    Javascript

---

A small utility to sign vanilla node.js http(s) request options using Amazon's AWS Signature Version 4.Can also be used in the browser.

amazon aws signature s3 ec2 autoscaling cloudformation elasticloadbalancing elb elasticbeanstalk cloudsearch dynamodb kinesis lambda glacier sqs sns iam sts ses swf storagegateway datapipeline directconnect redshift opsworks rds monitoring cloudtrail cloudfront codedeploy elasticache elasticmapreduce elastictranscoder emr cloudwatch mobileanalytics cognitoidentity cognitosync cognito containerservice ecs appstream keymanagementservice kms config cloudhsm route53 route53domains logs

swarrot - A lib to consume message from any Broker

•    PHP

---

Swarrot is a PHP library to consume messages from any broker. Heavily inspired by stackphp/builder you can use Swarrot\Processor\Stack\Builder to stack your processors. Using the built in processors or by creating your own, you can extend the behavior of your base processor. In this example, your processor is decorated by 2 other processors. The ExceptionCatcherProcessor which decorates your own with a try/catch block and the MaxMessagesProcessor which stops your worker when some messages have been consumed.

swarrot rabbitmq rabbit sqs queue queueing

aws2js - AWS (Amazon Web Services) APIs client implementation for node.js

•    Javascript

---

WARNING: aws2js is deprecated. Use aws-sdk instead. Amazon Web Services node.js module. Originally a fork of aws-lib.

amazon aws rest api https query-api ec2 rds ses elb s3 iam auto-scaling cloudwatch elasticache sqs simpledb sdb security-token-service sts dynamodb sns emr elastic-mapreduce

clientside_aws - A client-side implementation of popular AWS services (S3, SQS, DynamoDB, Elastic Transcoder) for development + testing using ruby in docker

•    Ruby

---

This code is meant to be used by developers who are attempting to build web applications on AWS but wish to run client-side testing and validation. Presently, this project mocks DynamoDB and SQS.While creating and tearing down "free-tier" SQS and DynamoDB databases may be an acceptable solution for some, the time required (tens of seconds or minutes) quickly makes TDD (test-driven development) impractical. Just like we can use an in-memory sqlite3-based solution for mocking Mysql databases with ActiveRecord, we can now mock SQS and DynamoDB databases in memory using Redis.

aws-sdk sqs dynamodb-databases docker

aws.js - Dead simple AWS client for node.js

•    Javascript

---

Dead simple Amazon Web Services client

ec2 amazon amazon-web-services aws sqs s3

lawos - SQS Worker for AWS Lambda.

•    Javascript

---

Wrapper for Amazon SQS Worker with AWS Lambda

aws sqs-queue worker lambda sqs-poller sqs amazon

serverless-sqs-alarms-plugin - Serverless wrapper to setup CloudWatch Alarms for SQS

•    Javascript

---

Serverless plugin to to configure CloudWatch alarms for SQS queues

serverless sqs aws lambda sns plugin

sqs-worker-serverless - Example for SQS Worker in AWS Lambda using Serverless

•    Javascript

---

Example for an Amazon SQS worker with AWS Lambda using lawos and serverless.

serverless sqs worker lambda aws dynamodb

simple-sqs - A simple wrapper around the AWS SQS queue service

•    Javascript

---

A simple wrapper around the AWS SQS queue service

sqs queue queueing aws

Squiss - High-volume Amazon SQS Poller for Node.js

•    Javascript

---

Squiss aims to process as many messages simultaneously as possible. Set the maxInFlight option to the number of messages your app can handle at one time without choking, and Squiss will attempt to keep that many messages flowing through your app, grabbing more as you mark each message as handled or ready for deletion. If the queue is empty, Squiss will maintain an open connection to SQS, waiting for any messages that appear in real time. By default, anyway. You can configure it to poll however you want. Squiss don't care. Don't be scared of new -- you need to create a new Squiss instance for every queue you want to poll. Squiss is an EventEmitter, so don't forget to call squiss.on('message', (msg) => msg.del()) at the very least.

aws amazon sqs polling poll poller queue

sqs - A message queue using Amazon Simple Queue Service.

•    Javascript

---

A message queue using Amazon Simple Queue Service.Some of the options can be configured using env vars. See below for more.

sqs aws amazon queue message

sqs-producer - Simple scaffolding for applications that produce SQS messages

•    Javascript

---

Simple scaffolding for applications that produce SQS messages

aws sqs producer queue

draccus - A tool for stashing messages queued up in Amazon's SQS.

•    Javascript

---

A tool for stashing messages queued up in Amazon's SQS.Use it as a disaster recovery mechanism to drain a queue, or use it to guarantee delivery of transaction logs to persistent storage.

sqs s3 aws logs events

aws-lambda-fanout - A sample AWS Lambda function that accepts messages from an Amazon Kinesis Stream and transfers the messages to another data transport

•    Javascript

---

This function answers a need I have had multiple times, where I want to replicate data from an Amazon Kinesis Stream to another account or another region for processing, or to another environment such as development.This AWS Lambda function can be used to propagate incoming messages from Amazon Kinesis Streams or Amazon DynamoDB Streams to other services (Amazon SNS, Amazon SQS, Amazon Elasticsearch Service, Amazon Kinesis Streams, Amazon Kinesis Firehose, AWS IoT, AWS Lambda, Amazon ElastiCache for Memcached and Redis), regions or accounts. This function generates metrics that will be published to Amazon CloudWatch Metrics, in the Custom/FanOut namespace.

amazon kinesis dynamodb sqs sns elasticache elasticsearch iot memcached redis firehose lambda

amazon-sqs-java-messaging-lib - This Amazon SQS Java Messaging Library holds the Java Message Service compatible classes, that are used for communicating with Amazon Simple Queue Service

•    Java

---

The Amazon SQS Java Messaging Library holds the Java Message Service compatible classes, that are used for communicating with Amazon Simple Queue Service.

amazon-sqs sqs jms jms-queue jms-client