Nomad - Easily Deploy Applications at Any Scale

•    Go

Nomad is a cluster manager, designed for both long lived services and short lived batch processing workloads. Developers use a declarative job specification to submit work, and Nomad ensures constraints are satisfied and resource utilization is optimized by efficient task packing. Nomad supports all major operating systems and virtualized, containerized, or standalone applications.

orleans - Orleans - Distributed Virtual Actor Model

•    CSharp

Orleans is a framework that provides a straight-forward approach to building distributed high-scale computing applications, without the need to learn and apply complex concurrency or other scaling patterns.It was created by Microsoft Research implementing the Virtual Actor Model and designed for use in the cloud.

maintainablecss

•    CSS

Write CSS without worrying that overzealous, pre-existing styles will cause problems. MaintainableCSS is an approach to writing modular, scalable and of course, maintainable CSS.

cote - A Node.js library for building zero-configuration microservices.

•    Javascript

cote lets you write zero-configuration microservices in Node.js without nginx, haproxy, redis, rabbitmq or anything else. It is batteries — and chargers! — included. Join us on for anything related to cote.

awesome-sre - A curated list of awesome Site Reliability and Production Engineering resources.

A curated list of awesome Site Reliability and Production Engineering resources.

awesome-scalability - Scalable, Available, Stable, Performant, and Intelligent System Design Patterns

An updated and curated list of readings to illustrate best practices and patterns in building scalable, available, stable, performant, and intelligent large-scale systems. Concepts are explained in the articles of prominent engineers and credible references. Case studies are taken from battle-tested systems that serve millions to billions of users. Understand your problems: scalability problem (fast for a single user but slow under heavy load) or performance problem (slow for a single user) by reviewing some design principles and checking how scalability and performance problems are solved at tech companies. The section of intelligence are created for those who work with data and machine learning at big (data) and deep (learning) scale.

system_design - Preparation links and resources for system design questions

Learning about and implementing large-scale distributed system is not easy. I do not want to give the impression that it's something that can be learnt in a month. What this repository aims to achieve, is for software engineers and students to get a rough idea of how the thought process of designing a large scale works and how big companies have managed to solve really hard problems. Along with that, there is a recent trend for companies to have an open-ended interview with system design questions, which is at times hard for engineers of all levels if they haven't gotten the opportunity to work on such systems themselves. This is a collection of links/documents for the following use cases: a) Prepare for a system design or open-ended rounds. b) Learn more about how large-scale systems work and thought process of designing a new system.

brooklin - An extensible distributed system for reliable nearline data streaming at scale

•    Java

Brooklin is a distributed system intended for streaming data between various heterogeneous source and destination systems with high reliability and throughput at scale. Designed for multitenancy, Brooklin can simultaneously power hundreds of data pipelines across different systems and can easily be extended to support new sources and destinations. Brooklin offers a flexible API that can be extended to support a wide variety of source and destination systems. It is not confined to single type of source or destination system.

AxonFramework - High Performance and Scalability framework for Java

•    Java

A CQRS (Command Query Responsibility Segregation) Framework for Scalable, High-Performance Java Applications.

node-api-boilerplate - DDD/Clean Architecture inspired boilerplate for Node web APIs

•    Javascript

An opinionated boilerplate for Node web APIs focused on separation of concerns and scalability.

AElf - A scalable blockchain built on clusters

•    CSharp

Welcome to AElfs’ official GitHub repository. The code is still in its early stages and is under constant change to improve its quality and functionality. You can find out more about AElf by reading the White Paper.

moosefs - MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System

•    C

MooseFS is a Petabyte Open Source Network Distributed File System. It is easy to deploy and maintain, fault tolerant, highly performing, easily scalable, POSIX compliant. MooseFS Linux Client uses FUSE. MooseFS macOS Client uses FUSE for macOS.

may - rust stackful coroutine library

•    Rust

Rust Stackful Coroutine Library. May is a high performance stackful coroutine library that can be thought of rust version goroutine. You can use it easily to design and develop massive concurrent programs in Rust.

Stratosphere

Mono compatible .NET/C# library with set of primitives to work with table, queue and block containers with corresponding implementations for Amazon SimpleDB, SQS and S3. Additionally includes local machine (file system and SQLite) implementations to enable debugging and testing.

Partitioned CloudQueue - Azure Storage Queue without scalability limits

PartitionedCloudQueue makes it easier for Azure Storage users to deal with scalability limitations of single Azure Queue (500 msgs per second per queue). You'll no longer have to implement custom partitioning if all you need is one infinitely-scalable Azure Storage queue.

Interop Router

This project establishes a communication framework and job dispatcher for a mixed operating system cluster environment.

tuist - 🚀 Create, maintain, and interact with Xcode projects at scale

•    Swift

Tuist is a command line tool that helps you generate, maintain and interact with Xcode projects. It's open source and written in Swift.

Thespian - Python Actor concurrency library

•    Python

This library provides the framework of an Actor model for use by applications implementing Actors.Alternate fork: https://github.com/kquick/Thespian.

usl4j - A reasonably complete implementation of the Universal Scalability Law model.

•    Java

A reasonably complete implementation of the Universal Scalability Law model.

drwmutex - Distributed RWMutex in Go

•    Go

The default Go implementation of sync.RWMutex does not scale well to multiple cores, as all readers contend on the same memory location when they all try to atomically increment it. This repository provides an n-way RWMutex, also known as a "big reader" lock, which gives each CPU core its own RWMutex. Readers take only a read lock local to their core, whereas writers must take all locks in order. Note that the current implementation only supports x86 processors on Linux; other combinations will revert (automatically) to the old sync.RWMutex behaviour. To support other architectures and OSes, the appropriate cpu_GOARCH.go and cpus_GOOS.go files need to be written. If you have a different setup available, and have the time to write one of these, I'll happily accept patches.