Nomad is a cluster manager, designed for both long lived services and short lived batch processing workloads. Developers use a declarative job specification to submit work, and Nomad ensures constraints are satisfied and resource utilization is optimized by efficient task packing. Nomad supports all major operating systems and virtualized, containerized, or standalone applications.
cluster-manager job-scheduler manage-workloads cluster-management deployment scalabilityOrleans is a framework that provides a straight-forward approach to building distributed high-scale computing applications, without the need to learn and apply complex concurrency or other scaling patterns.It was created by Microsoft Research implementing the Virtual Actor Model and designed for use in the cloud.
actor-model distributed-actors distributed-systems cloud-computing scalability reactive concurrency orleansWrite CSS without worrying that overzealous, pre-existing styles will cause problems. MaintainableCSS is an approach to writing modular, scalable and of course, maintainable CSS.
css maintainance modular scalability webcote lets you write zero-configuration microservices in Node.js without nginx, haproxy, redis, rabbitmq or anything else. It is batteries — and chargers! — included. Join us on for anything related to cote.
microservices nodejs scalability high-availability zero-configuration microservice zero-conf mesh network auto-discovery scalable fault-tolerantA curated list of awesome Site Reliability and Production Engineering resources.
site-reliability-engineering production availability monitoring post-mortem reliability-engineering capacity-planning service-level-agreement scalability reliability alerting on-call site-reliability postmortem incident-response sre awesome awesome-list devops observabilityAn updated and curated list of readings to illustrate best practices and patterns in building scalable, available, stable, performant, and intelligent large-scale systems. Concepts are explained in the articles of prominent engineers and credible references. Case studies are taken from battle-tested systems that serve millions to billions of users. Understand your problems: scalability problem (fast for a single user but slow under heavy load) or performance problem (slow for a single user) by reviewing some design principles and checking how scalability and performance problems are solved at tech companies. The section of intelligence are created for those who work with data and machine learning at big (data) and deep (learning) scale.
system-design backend scalability site-reliability-engineering sre interview architecture devops site-reliability design-patterns back-end back-end-development interview-questions design-systems awesome-list microservices distributed-systems design-system tech big-dataLearning about and implementing large-scale distributed system is not easy. I do not want to give the impression that it's something that can be learnt in a month. What this repository aims to achieve, is for software engineers and students to get a rough idea of how the thought process of designing a large scale works and how big companies have managed to solve really hard problems. Along with that, there is a recent trend for companies to have an open-ended interview with system design questions, which is at times hard for engineers of all levels if they haven't gotten the opportunity to work on such systems themselves. This is a collection of links/documents for the following use cases: a) Prepare for a system design or open-ended rounds. b) Learn more about how large-scale systems work and thought process of designing a new system.
engineering facebook architecture scalability concurrency interview preparation system-design scale-systemsBrooklin is a distributed system intended for streaming data between various heterogeneous source and destination systems with high reliability and throughput at scale. Designed for multitenancy, Brooklin can simultaneously power hundreds of data pipelines across different systems and can easily be extended to support new sources and destinations. Brooklin offers a flexible API that can be extended to support a wide variety of source and destination systems. It is not confined to single type of source or destination system.
distributed-systems kafka linkedin scalability change-data-capture data-streaming kafka-mirror-makerA CQRS (Command Query Responsibility Segregation) Framework for Scalable, High-Performance Java Applications.
cqrs event-sourcing framework application-framework scalabilityAn opinionated boilerplate for Node web APIs focused on separation of concerns and scalability.
boilerplate ddd clean-architecture nodejs sequelize scalability good-practicesWelcome to AElfs’ official GitHub repository. The code is still in its early stages and is under constant change to improve its quality and functionality. You can find out more about AElf by reading the White Paper.
blockchain scalabilityMooseFS is a Petabyte Open Source Network Distributed File System. It is easy to deploy and maintain, fault tolerant, highly performing, easily scalable, POSIX compliant. MooseFS Linux Client uses FUSE. MooseFS macOS Client uses FUSE for macOS.
dfs software-defined-storage posix filesystem file-system distributed-file-system clustering distributed-storage distributed-computing fuse big-data snapshot storage-tiering high-availability scalability storage moosefs hadoop posix-compliantRust Stackful Coroutine Library. May is a high performance stackful coroutine library that can be thought of rust version goroutine. You can use it easily to design and develop massive concurrent programs in Rust.
coroutines green-threads fibers async scalability io primitives high-performance generatorMono compatible .NET/C# library with set of primitives to work with table, queue and block containers with corresponding implementations for Amazon SimpleDB, SQS and S3. Additionally includes local machine (file system and SQLite) implementations to enable debugging and testing.
amazon amazon-s3 amazon-simpledb amazon-sqs amazon-web-services mono scalabilityPartitionedCloudQueue makes it easier for Azure Storage users to deal with scalability limitations of single Azure Queue (500 msgs per second per queue). You'll no longer have to implement custom partitioning if all you need is one infinitely-scalable Azure Storage queue.
azure azure-queue azure-storage queue scalabilityThis project establishes a communication framework and job dispatcher for a mixed operating system cluster environment.
beowulf cluster hpc interop interoperability load-balancing scalabilityTuist is a command line tool that helps you generate, maintain and interact with Xcode projects. It's open source and written in Swift.
xcode scalability productivityThis library provides the framework of an Actor model for use by applications implementing Actors.Alternate fork: https://github.com/kquick/Thespian.
actor-model actors concurrency fault-tolerance distributed-systems distributed-actors scalabilityA reasonably complete implementation of the Universal Scalability Law model.
universal-scalability-law usl capacity-planning java-8 scalabilityThe default Go implementation of sync.RWMutex does not scale well to multiple cores, as all readers contend on the same memory location when they all try to atomically increment it. This repository provides an n-way RWMutex, also known as a "big reader" lock, which gives each CPU core its own RWMutex. Readers take only a read lock local to their core, whereas writers must take all locks in order. Note that the current implementation only supports x86 processors on Linux; other combinations will revert (automatically) to the old sync.RWMutex behaviour. To support other architectures and OSes, the appropriate cpu_GOARCH.go and cpus_GOOS.go files need to be written. If you have a different setup available, and have the time to write one of these, I'll happily accept patches.
locking synchronization scalability multi-core
We have large collection of open source products. Follow the tags from
Tag Cloud >>
Open source products are scattered around the web. Please provide information
about the open source projects you own / you use.
Add Projects.