Minio - Open source object storage server compatible with Amazon S3 APIs

•    Go

---

Minio is an object storage server released under Apache License v2.0. It is compatible with Amazon S3 cloud storage service. It is best suited for storing unstructured data such as photos, videos, log files, backups and container / VM images. Size of an object can range from a few KBs to a maximum of 5TB.Minio server is light enough to be bundled with the application stack, similar to NodeJS, Redis and MySQL.

aws-s3 storage cloud s3-storage cloud-storage object-storage cloud-native object-store file-store

S3 - Node.js implementation of a server handling the Amazon S3 protocol

•    Javascript

---

CloudServer (formerly S3 Server) is an open-source Amazon S3-compatible object storage server that is part of Zenko, Scality’s Open Source Multi-Cloud Data Controller.CloudServer provides a single AWS S3 API interface to access multiple backend data storage both on-premise or public in the cloud.

aws-s3 docker storage cloud s3-storage cloud-storage cloud-native object-storage nodejs aws-s3-alernative

cloudserver - Zenko CloudServer, an open-source Node

•    Javascript

---

CloudServer (formerly S3 Server) is an open-source Amazon S3-compatible object storage server that is part of Zenko, Scality’s Open Source Multi-Cloud Data Controller. CloudServer provides a single AWS S3 API interface to access multiple backend data storage both on-premise or public in the cloud.

aws-s3 docker multiple-backends storage cloud s3-storage cloud-storage cloud-native object-storage nodejs s3 server

droppy - Self-hosted file storage

•    Javascript

---

droppy is a self-hosted file storage server with a web interface and capabilities to edit files and view media directly in the browser. It is particularly well-suited to be run on low-end hardware like the Raspberry Pi. droppy maintains a in-memory representation of the files directory. If you're on slow storage and/or serving 100k or more files, the initial indexing on startup will likely take some time.

self-hosted file-server cloud-storage nodejs media-server image-gallery codemirror plyr personal file server http https media cloud storage self hosted

chartmuseum - Helm Chart Repository with support for Amazon S3, Google Cloud Storage, Microsoft Azure Blob Storage, Alibaba Cloud OSS Storage, and Openstack Object Storage

•    Go

---

ChartMuseum is an open-source Helm Chart Repository written in Go (Golang), with support for cloud storage backends, including Google Cloud Storage, Amazon S3, Microsoft Azure Blob Storage, Alibaba Cloud OSS Storage and Openstack Object Storage. Works as a valid Helm Chart Repository, and also provides an API for uploading new chart packages to storage etc.

helm kubernetes chartmuseum

CloudBoost - One Complete Serverless Platform to build your app in half less time

•    Javascript

---

CloudBoost can power your app's backend, including data storage, user authentication, real-time notifications, search and more. It provides single framework for Data-Storage / JSON Storage / BLOB Storage, 100% data ownership, Realtime Search, Cache, Queues, Horizontally scalable etc.

backend-as-service backend-framework baas api-server rest-api database-as-a-service

OrangeFS - Scale-out Network File System

•    C

---

OrangeFS is a scale-out network file system designed for use on high-end computing (HEC) systems that provides very high-performance access to multi-server-based disk storage, in parallel. The OrangeFS server and client are user-level code, making them very easy to install and manage. OrangeFS has optimized MPI-IO support for parallel and distributed applications, and it is leveraged in production installations and used as a research platform for distributed and parallel storage.

filesystem distributed-filesystem storage distributed-storage parallel-virtual-filesystem nas

OpenEBS - Containerized Storage for Containers

•    Go

---

OpenEBS is containerized block storage written in Go for cloud native and other environments w/ per container (or pod) QoS SLAs, tiering and replica policies across AZs and environments, and predictable and scalable performance.

storage storage-container nomad persistent-storage docker pod devops k8s kubernetes ebs ebs-volumes block-storage containerization persistent-workloads cloud-native object-store

OpenStack - Software for building Private and Public Clouds

•    Python

---

OpenStack is a cloud operating system that controls large pools of compute, storage, and networking resources throughout a datacenter, all managed through a dashboard that gives administrators control while empowering their users to provision resources through a web interface.

cloud cloud-computing datacenter iaas infrastructure-as-a-service cloud-management

Git Large File Storage - Git extension for versioning large files

•    Go

---

Git LFS is a command line extension and specification for managing large files with Git. The client is written in Go, with pre-compiled binaries available for Mac, Windows, Linux, and FreeBSD.

git-lfs git file-storage storage git-extension

Ceph - Distributed Object Store

•    C++

---

Ceph provides seamless access to objects using native language bindings or radosgw, a REST interface that’s compatible with applications written for S3 and Swift. Ceph’s RADOS Block Device (RBD) provides access to block device images that are striped and replicated across the entire storage cluster. Ceph provides a POSIX-compliant network file system that aims for high performance, large data storage, and maximum compatibility with legacy applications.

object-store block-device file-system distributed block filesystem distributed-filesystem distributed-storage

ForestDB - A Fast Key-Value Storage Engine Based on Hierarchical B+-Tree Trie

•    C++

---

ForestDB is a key-value storage engine developed by Couchbase Caching and Storage Team, and its main index structure is built from Hierarchical B+-Tree based Trie, called HB+-Trie. ForestDB paper has been published in IEEE Transactions on Computers.

key-value-store key-value cache b-tree trie database

Gluster Filesystem - Scalable Network Filesystem

•    C

---

Gluster is a software defined distributed storage that can scale to several petabytes. It provides interfaces for object, block and file storage. It is a distributed scale-out filesystem that allows rapid provisioning of additional storage based on your storage consumption needs. It incorporates automatic failover as a primary feature.

distributed-filesystem filesystem distributed storage scalable-storage network-storage

zimg - A lightweight and high performance image storage and processing system.

•    C

---

Project zimg is a lightweight image storage and processing system. It's written in C and it has high performance in image field. The zimg is designed for high concurrency image server. It supports many features for storing and processing images.The concurrent I/O, distributed storage and in time processing ability of zimg is excellent. You needn't nginx in your image server any more. In the benchmark test, zimg can deal with 3000+ image downloading task per second and 90000+ HTTP echo request per second on a high concurrency level. The performance is higher than PHP or other image processing server. More infomation of zimg is in the documents below.

oio-sds - OpenIO Software Defined Storage

•    C

---

OpenIO SDS is a software solution for object storage, targeting very large-scale unstructured data volumes.Please refer to BUILD.md for detailed information about how to compile and configure the solution.

storage object-storage software-defined-storage

Sheepdog - Distributed Storage System for QEMU

•    C

---

Sheepdog is a distributed object storage system for volume and container services and manages the disks and nodes intelligently. Sheepdog features ease of use, simplicity of code and can scale out to thousands of nodes. The block level volume abstraction can be attached to QEMU virtual machines and Linux SCSI Target and supports advanced volume management features such as snapshot, cloning, and thin provisioning.

qemu qemu-kvm iscsi iscsi-target blockdevice storage distributed-storage virtualization vmm software-defined-storage sdn

Usergrid - The BaaS Framework you run

•    Java

---

Usergrid is an open-source Backend-as-a-Service (“BaaS” or “mBaaS”) composed of an integrated distributed NoSQL database, application layer and client tier with SDKs for developers looking to rapidly build web and/or mobile applications. It provides elementary services (user registration & management, data storage, file storage, queues) and retrieval features (full text search, geolocation search, joins) to power common app features.

backend backend-as-service backend-framework baas api-server rest-api nosql cache search-engine

thanos - Highly available Prometheus setup with long term storage capabilities.

•    Go

---

Thanos is a set of components that can be composed into a highly available metric system with unlimited storage capacity. It can be added seamlessly on top of existing Prometheus deployments and leverages the Prometheus 2.0 storage format to cost-efficiently store historical metric data in any object storage while retaining fast query latencies. Additionally, it provides a global query view across all Prometheus installations and can merge data from Prometheus HA pairs on the fly.

prometheus google-cloud-storage high-availability prometheus-ha-pairs thanos s3 prometheus-setup metric-data storage

Microsoft SQL Server Remote Blob Storage Samples

•    

---

RBS is a library API set that is designed to move storage of BLOB data from Microsoft SQL Server to external Content Addressable Stores (CAS). A reference to the blob is stored in the database. An application stores and accesses blob data by calling into the RBS client library...

file-storage pkgod

ardb - A redis protocol compatible nosql, it support multiple storage engines as backend like Google's LevelDB, Facebook's RocksDB, OpenLDAP's LMDB, PerconaFT, WiredTiger, ForestDB

•    C++

---

Ardb is a BSD licensed, redis-protocol compatible persistent nosql, it support multiple storage engines as backend like Google's LevelDB, Facebook's RocksDB, OpenLDAP's LMDB, WiredTiger, PerconaFT,Couchbase's ForestDB the default backend is Facebook's RocksDB. Rocksdb is the default storage engine, to compile with rocksdb, just type make to compile server & lib & tests.

redis key-value persistence database server c-plus-plus rocksdb lmdb leveldb wiredtiger percona forestdb nosql nosql-database