Displaying 1 to 13 from 13 results

awesome-scalability - Scalable, Available, Stable, Performant, and Intelligent System Design Patterns


An updated and curated list of readings to illustrate best practices and patterns in building scalable, available, stable, performant, and intelligent large-scale systems. Concepts are explained in the articles of prominent engineers and credible references. Case studies are taken from battle-tested systems that serve millions to billions of users. Understand your problems: scalability problem (fast for a single user but slow under heavy load) or performance problem (slow for a single user) by reviewing some design principles and checking how scalability and performance problems are solved at tech companies. The section of intelligence are created for those who work with data and machine learning at big (data) and deep (learning) scale.

marmot - Marmot workflow execution engine

  •    Go

Marmot is a service for processing workflows targeting DevOps/SRE needs.NOTICE This product is still in development and is not production ready.

docker-base-images - Base docker images for Apiary applications

  •    Python

This repository helps keep Apiary environment, services and libraries consistent and in sync. Each directory has an area of responsibility and the libraries should derive from the respective image.

heroku-datadog-drain-golang - Funnel metrics from multiple Heroku apps into DataDog using statsd.

  •    Go

Funnel metrics from multiple Heroku apps into DataDog using statsd. OPTIONAL: Setup Heroku build packs, including the Datadog DogStatsD client. If you already have a StatsD client running, see the STATSD_URL configuration option below.

s3-streaming-upload - s3-streaming-upload is node

  •    CoffeeScript

s3-streaming-upload is node.js library that listens to your stream and upload its data to Amazon S3. It is heavily inspired by knox-mpu, but unlike it, it does not buffer data to disk and is build on top of official AWS SDK instead of knox.

kapo - Wrap any command in a status socket

  •    Go

Wrap any command in a status socket. When a program is executed under kapo a JSON-speaking HTTP server is started and the state of the process is reported to whomever requests it.

Sia-EventUI - User interface for SIA event timeline

  •    Javascript

See the Root repository for full project information and an overview of how services fit together. SIA is configured for Wepback's hot module reloading, so changes should automatically appear in your browser.

ivy - A Node.js queue library focused on easy, yet flexible task execution.

  •    CoffeeScript

Ivy is node.js queue library focused on easy, yet flexible task execution. There are a lot of parts and components in distributed environment. This is how Ivy understands them.

index-digest - Analyses your database queries and schema and suggests indices and schema improvements

  •    Python

Analyses your database queries and schema and suggests indices improvements. You can use index-digest as your database linter. The goal is to provide the user with actionable reports instead of just a list of statistics and schema details. Inspired by Percona's pt-index-usage. This tool supports MySQL 5.5, 5.6, 5.7, 8.0 and MariaDB 10.0, 10.2 and runs under Python 2.7, 3.4, 3.5 and 3.6.

gcdt - glomex cloud deployment tools to use infrastructure as code (IaC) on AWS

  •    Python

gcdt CLI tools make it easy for you to code, automate, and deploy your AWS infrastructure. The gcdt command line tools have emerged from our experiences at glomex while working extensively with AWS services like Cloudformation, CodeDeploy, AWS Lambda, and API Gateway. gcdt is based on the same technology AWS uses to build AWS-CLI and Boto3 tools.

provision - Digital Rebar Provision is a simple and powerful Golang executable that provides a complete API-driven DHCP/PXE/TFTP provisioning system

  •    Go

simple, fast and open API-driven server provisioning. Digital Rebar Provision (DRP) is a APLv2 simple Golang executable that provides a simple yet complete API-driven DHCP/PXE/TFTP provisioning and workflow system.

sre-interview-prep-guide - Site Reliability Engineer Interview Preparation Guide


This repository is an attempt to consolidate useful resources for Site Reliability Engineer (SRE) interview preparation.