Vitess - Database clustering system for horizontal scaling of MySQL

•    Go

---

Vitess is a database clustering system for horizontal scaling of MySQL through generalized sharding. By encapsulating shard-routing logic, Vitess allows application code and database queries to remain agnostic to the distribution of data onto multiple shards. With Vitess, you can even split and merge shards as your needs grow, with an atomic cutover step that takes only a few seconds.

cncf mysql database-cluster shard kubernetes scale-out

Gearman - Application Framework to farm out work to other Machines

•    C

---

Gearman provides a generic application framework to farm out work to other machines or processes that are better suited to do the work. It allows you to do work in parallel by doing load balancing. It also supports to call functions between languages. It is the nervous system for how distributed processing communicates. It is fault tolerant.

distributed scale-out load-balance job-server job-queue queue framework scalable

VoltDB - Fast Scalable SQL DBMS with ACID

•    Java

---

VoltDB was specifically designed for contemporary software applications that are pushed beyond their limits by high volume data sources. VoltDB provides the ability to capture, store and process incoming data at millions of read/write operations per second. And VoltDB’s relational model opens that data to be analyzed in real-time, using familiar Business Intelligence tools, to identify data patterns and trends, spot anomalies, or perform tracking and alerting.

database relational acid bigdata scale-out distributed distributed-database oltp analytics

Postgres-XL - Scalable Open Source PostgreSQL-based Database Cluster

•    C

---

Postgres-XL is a horizontally scalable open source SQL database cluster, flexible enough to handle varying database workloads like OLTP, Business Intelligence requiring MPP parallelism, Key value store, GIS Geospatial and lot more.

postgres-tools database-cluster olap business-intelligence big-data scale-out

edge-dev - NexentaEdge DevOps Edition, scale-out S3, SWIFT, NFS and iSCSI/NBD unified storage solution

•    API

---

Fast, feature rich and easy to use File, Block and Object storage for your Cloud-Native Applications. It is designed to make use of off the shelf storage and networking infrastructure and present it as enterprise grade SDS (Software-Defined Storage) solution. NexentaEdge deployed as containers on physical or virtual hosts, pooling allocated storage capacity and presenting it for consumption by applications. NexentaEdge designed with High-Performance and Data Reduction in mind. It provides best in class throughput and latency characteristics while saving overall allocated space with built-in in-line global De-Duplication, Compression and off-line Erasure Encoding.

storage scale-out nfs-server iscsi-target s3-storage swift-storage containerized-applications nfs infrastructure stack iscsi nbd storage-service enterprise scale kubernetes

aistore - AIStore: scalable storage for AI applications

•    Go

---

AIStore (AIS for short) is a built from scratch storage solution for AI applications. At its core, it's open-source object storage with extensions tailored for AI and, specifically, for petascale deep learning. As a storage system, AIS is a distributed object store with a RESTful S3-like API, and the gamut of capabilities that one would normally expect from an object store: eventual consistency, flat namespace, versioning, and all the usual read/write and control primitives to read and write objects and create, destroy, list, and configure buckets that contain those objects.

high-performance erasure-coding high-availability object-storage map-reduce scale-out

db-sharding - Oracle Sharding tools for use in client applications.

•    Java

---

This library provides Oracle Sharding routing implementation for use in client applications. NOTE: this is a beta 0.1 version of the library.

oracle-database oracle-sharding routing routing-engine middleware database-middleware client-lib chunk catalog-database shards scale-out cross-shard-queries fault-isolation mid-tier-routing