osync - A robust two way (bidirectional) file sync script based on rsync with fault tolerance, ACL support and time control

•    Shell

---

A two way filesync script running on bash Linux, BSD, Android, MacOSX, Cygwin, MSYS2, Win10 bash and virtually any system supporting bash). File synchronization is bidirectional, and can be run manually, as scheduled task, or triggered on file changes in daemon mode. It is a command line tool rsync wrapper with a lot of additional features baked in. This is a quickstart guide, you can find the full documentation on the author's site.

synchronization rsync-wrapper file-replication replication sync-files acl-replication time-control

SQL Server Replication Explorer

•    

---

SQL Server Replication Explorer is a client tool for browsing through Microsoft SQL Server replication topology. It can also be used for troubleshooting and monitoring of the Microsoft SQL Server replication.

replication database distribution sql-server sql-server-2005 sql-server-2008 tools

ZooKeeper - Centralized service for maintaining configuration information

•    Java

---

ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services. All of these kinds of services are used in some form or another by distributed applications.

service-discovery configuration-management service-coordination

orchestrator - MySQL replication topology management and HA

•    Go

---

orchestrator actively crawls through your topologies and maps them. It reads basic MySQL info such as replication status and configuration.It provides with slick visualization of your topologies, including replication problems, even in the face of failures.

mysql replication high-availability management-system database-tools

Bucardo - Asynchronous PostgreSQL Replication System

•    Perl

---

Bucardo is an asynchronous PostgreSQL replication system, allowing for both multi-master and multi-slave operations.

database-replication replication db-tools

pglogical - Logical Replication extension for PostgreSQL 9

•    C

---

The pglogical extension provides logical streaming replication for PostgreSQL, using a publish/subscribe model. It is based on technology developed as part of the BDR project (http://2ndquadrant.com/BDR). To use pglogical the provider and subscriber must be running PostgreSQL 9.4 or newer.

postgresql replication logical-decoding database-replication subscription publish-subscribe data-transformation data-transport etl cdc zero-downtime

Tungsten Clustering and Replication

•    Java

---

Tungsten is a family of open source technologies for database clustering and replication. Tungsten includes replication, management, SQL routing, and proxying that improve database availability, protect data, and raise application throughput.

LizardFS - Software Defined Storage, Distributed, Parallel, Scalable, Fault-tolerant, Geo-Redundant and Highly available file system

•    C++

---

LizardFS Software Defined Storage is a distributed, parallel, scalable, fault-tolerant, Geo-Redundant and highly available file system. It spreads data over a number of physical servers, making it visible to an end user as a single file system.

distributed-filesystem filesystem nas distributed-systems distributed-computing distributed-storage fault-tolerance snapshot qos erasure-coding replication replicas geo-replication hsm hierarchical-storage hadoop

DBTransfer - Versatile and fast database transfer tool

•    Java

---

DBTransfer is a multi-platform java tool, that aims to replicate one database (JDBC or MS Access) to another (JDBC), using an one to one conversion.

database-tools database-replication replication

Perst - object-oriented embedded database

•    Java

---

Perst is McObject's open source, dual license, object-oriented embedded database system (ODBMS). Perst gives developers the ability to sort, store and retrieve objects in their applications with maximum speed and with low memory and storage overhead, while leveraging the object-oriented paradigm of Java and C#. It is available in one edition developed as an all-Java embedded database, and another implemented in C# (for Microsoft .NET Framework applications).

database object-database replication embedded persistance

Citus - Scalable PostgreSQL for multi-tenant and real-time workloads

•    C

---

Citus is a distributed database that scales across commodity servers using transparent sharding and replication. Citus extends the underlying database rather than forking it, giving developers and enterprises the power and familiarity of a relational database. As an extension, Citus supports new PostgreSQL releases, and allows you to benefit from new features while maintaining compatibility with existing PostgreSQL tools.

database citus multi-tenant postgresql scale sharding sql distributed-database postgres

389 Directory Server - Powerful OpenSource LDAP

•    C

---

The enterprise-class Open Source LDAP server for Linux. It is hardened by real-world use, is full-featured, supports multi-master replication, and already handles many of the largest LDAP deployments in the world. OpenLDAP and Fedora Directory Server were both derived from the original University of Michigan slapd project. In 1996 the original developers of slapd became Netscape employees and developed Netscape Directory Server, which is now Fedora Directory Server.

ldap identity-management directory-server

Xenon - Decentralized Control Plane Framework

•    Java

---

Xenon is a framework for writing small REST-based services. (Some people call them microservices.) The runtime is implemented in Java and acts as the host for the lightweight, asynchronous services. The programming model is language agnostic (does not rely on Java specific constructs) so implementations in other languages are encouraged. The services can run on a set of distributed nodes. Xenon provides replication, synchronization, ordering, and consistency for the state of the services. Because of the distributed nature of Xenon, the services scale well and are highly available.

rest-framework web-framework web-application-framework

Copycat - A novel implementation of the Raft consensus algorithm

•    Java

---

Copycat is a fault-tolerant state machine replication framework. Built on the Raft consensus algorithm, it handles replication and persistence and enforces strict ordering of inputs and outputs, allowing developers to focus on single-threaded application logic. Its event-driven model allows for efficient client communication with replicated state machines, from simple key-value stores to wait-free locks and leader elections. You supply the state machine and Copycat takes care of the rest, making it easy to build robust, safe distributed systems.

raft distributed-systems consensus raft-consensus-algorithm state-machine consensus-algorithm replication database

Slony-I - Replication System for PostgreSQL

•    C

---

Slony-I is a "master to multiple slaves" replication system with cascading and failover. Slony-I is a system designed for use at data centers and backup sites, where the normal mode of operation is that all nodes are available.

replication postgres-tools db-tools database-utlities

db4o

•    Java

---

db4o open source object database, native to Java and .NET.

database object-database replication embedded persistance

mosql - MongoDB to PostgreSQL Streaming Replication

•    Ruby

---

MoSQL imports the contents of your MongoDB database cluster into a PostgreSQL instance, using an oplog tailer to keep the SQL mirror live up-to-date. This lets you run production services against a MongoDB database, and then run offline analytics or reporting using the full power of SQL.

database-replication database-utilities db-tools

Griddb - High performance, High scalability and High reliability database for big data

•    C++

---

GridDB is an In-Memory NoSQL Database for highly scalable IoT applications . It has a KVS (Key-Value Store)-type data model that is suitable for sensor data stored in a timeseries. It is a database that can be easily scaled-out according to the number of sensors. High Reliability It is equipped with a structure to spread out the replication of key value data among fellow nodes so that in the event of a node failure, automatic failover can be carried out in a matter of seconds by using the replication function of other nodes.

nosql key-value-store in-memory timeseries timeseries-database iot

repmgr - The Most Popular Replication Manager for PostgreSQL (Postgres) - latest version 4

•    C

---

repmgr is a suite of open-source tools to manage replication and failover within a cluster of PostgreSQL servers. It enhances PostgreSQL's built-in replication capabilities with utilities to set up standby servers, monitor replication, and perform administrative tasks such as failover or switchover operations. repmgr 4 is a complete rewrite of the existing repmgr codebase, allowing the use of all of the latest features in PostgreSQL replication.

repmgr replication postgresql postgres

kingbus - A distributed MySQL binlog storage system built on Raft

•    Go

---

MySQL replication protocol compatibility, pull the binlog files from the master through gtid mode, and push the binlog file to slave through gtid mode in the same way. Geo-Replication, kingbus uses Raft to support Geo-Replication. The binlog data written to the cluster is guaranteed to be consistent between multiple nodes, and the order of binlog event is exactly the same as that on the master.

mysql raft mysql-binlog distributed-systems storage binlog