pglogical - Logical Replication extension for PostgreSQL 9

  •        42

The pglogical extension provides logical streaming replication for PostgreSQL, using a publish/subscribe model. It is based on technology developed as part of the BDR project (http://2ndquadrant.com/BDR). To use pglogical the provider and subscriber must be running PostgreSQL 9.4 or newer.

http://2ndquadrant.com/en/resources/pglogical/
https://github.com/2ndQuadrant/pglogical

Tags
Implementation
License
Platform

   




Related Projects

389 Directory Server - Powerful OpenSource LDAP

  •    C

The enterprise-class Open Source LDAP server for Linux. It is hardened by real-world use, is full-featured, supports multi-master replication, and already handles many of the largest LDAP deployments in the world. OpenLDAP and Fedora Directory Server were both derived from the original University of Michigan slapd project. In 1996 the original developers of slapd became Netscape employees and developed Netscape Directory Server, which is now Fedora Directory Server.

DBTransfer - Versatile and fast database transfer tool

  •    Java

DBTransfer is a multi-platform java tool, that aims to replicate one database (JDBC or MS Access) to another (JDBC), using an one to one conversion.

wal2json - JSON output plugin for changeset extraction

  •    C

wal2json is an output plugin for logical decoding. It means that the plugin have access to tuples produced by INSERT and UPDATE. Also, UPDATE/DELETE old row versions can be accessed depending on the configured replica identity. Changes can be consumed using the streaming protocol (logical replication slots) or by a special SQL API. The wal2json output plugin produces a JSON object per transaction. All of the new/old tuples are available in the JSON object. Also, there are options to include properties such as transaction timestamp, schema-qualified, data types, and transaction ids.

SymmetricDS - Multi Database Replication

  •    Java

SymmetricDS is a database and file synchronization solution that is platform-independent, web-enabled, and database agnostic. SymmetricDS was built to make data replication across two to tens of thousands of databases and file systems fast, easy and resilient. It supports near real time, bi-directional data replication across large node networks over the WAN or LAN.

membase - distributed key-value database

  •    C

Membase is an distributed, key-value database management system optimized for storing data behind interactive web applications. These applications must service many concurrent users, creating, storing, retrieving, aggregating, manipulating and presenting data in real-time. Supporting these requirements, membase processes data operations with quasi-deterministic low latency and high sustained throughput.


pghoard - PostgreSQL backup and restore service

  •    Python

pghoard is a PostgreSQL backup daemon and restore tooling that stores backup data in cloud object stores. PostgreSQL Point In Time Replication (PITR) consists of a having a database basebackup and changes after that point go into WAL log files that can be replayed to get to the desired replication point.

Maatkit - Power tools for open-source databases

  •    Perl

Maatkit is a toolkit for users, developers, and administrators of open-source databases. Most of Maatkit’s functionality is designed for MySQL. It makes MySQL easier and safer to manage. Maatkit could be used to prove replication is working correctly, fix corrupted data, automate repetitive tasks, speed up your servers, and much more.

Griddb - High performance, High scalability and High reliability database for big data

  •    C++

GridDB is an In-Memory NoSQL Database for highly scalable IoT applications . It has a KVS (Key-Value Store)-type data model that is suitable for sensor data stored in a timeseries. It is a database that can be easily scaled-out according to the number of sensors. High Reliability It is equipped with a structure to spread out the replication of key value data among fellow nodes so that in the event of a node failure, automatic failover can be carried out in a matter of seconds by using the replication function of other nodes.

PostgreSQL - Powerful, Open Source Object-Relational Database System

  •    C

PostgreSQL is a powerful, open source object-relational database system. It has more than 15 years of active development and a proven architecture that has earned it a strong reputation for reliability, data integrity, and correctness. It is fully ACID compliant, has full support for foreign keys, joins, views, triggers, and stored procedures (in multiple languages). It has native programming interfaces for most of the programming language.

tranquility - Tranquility helps you send real-time event streams to Druid and handles partitioning, replication, service discovery, and schema rollover, seamlessly and without downtime

  •    Scala

Tranquility helps you send event streams to Druid, the raddest data store ever (http://druid.io/), in real-time. It handles partitioning, replication, service discovery, and schema rollover for you, seamlessly and without downtime. Tranquility is written in Scala, and bundles idiomatic Java and Scala APIs that work nicely with Finagle, Samza, Spark, Storm, and Trident. You only need to include the modules you are actually using.

Citus - Scalable PostgreSQL for multi-tenant and real-time workloads

  •    C

Citus is a distributed database that scales across commodity servers using transparent sharding and replication. Citus extends the underlying database rather than forking it, giving developers and enterprises the power and familiarity of a relational database. As an extension, Citus supports new PostgreSQL releases, and allows you to benefit from new features while maintaining compatibility with existing PostgreSQL tools.

Bucardo - Asynchronous PostgreSQL Replication System

  •    Perl

Bucardo is an asynchronous PostgreSQL replication system, allowing for both multi-master and multi-slave operations.

repmgr - The Most Popular Replication Manager for PostgreSQL (Postgres) - latest version 4

  •    C

repmgr is a suite of open-source tools to manage replication and failover within a cluster of PostgreSQL servers. It enhances PostgreSQL's built-in replication capabilities with utilities to set up standby servers, monitor replication, and perform administrative tasks such as failover or switchover operations. repmgr 4 is a complete rewrite of the existing repmgr codebase, allowing the use of all of the latest features in PostgreSQL replication.

PMS

  •    Python

Powerful network messaging queueing mechanism, realized in Python. Paradigm: publish subscribe, like java messaging service (JMS). Data exchange is queued, reliable and efficient using local data replication.

consul-replicate - Consul cross-DC KV replication daemon.

  •    Go

This project provides a convenient way to replicate values from one Consul datacenter to another using the consul-replicate daemon.The daemon consul-replicate integrates with Consul to perform cross-data-center K/V replication. This makes it possible to manage application configuration from a central data center, with low-latency asynchronous replication to other data centers, thus avoiding the need for smart clients that would need to write to all data centers and queue writes to handle network failures.

Slony-I - Replication System for PostgreSQL

  •    C

Slony-I is a "master to multiple slaves" replication system with cascading and failover. Slony-I is a system designed for use at data centers and backup sites, where the normal mode of operation is that all nodes are available.

mosql - MongoDB to PostgreSQL Streaming Replication

  •    Ruby

MoSQL imports the contents of your MongoDB database cluster into a PostgreSQL instance, using an oplog tailer to keep the SQL mirror live up-to-date. This lets you run production services against a MongoDB database, and then run offline analytics or reporting using the full power of SQL.

pg_view - Get a detailed, real-time view of your PostgreSQL database and system metrics

  •    Python

pg_view is a powerful command-line tool that offers a detailed, real-time view of your PostgreSQL database and system metrics. It combines the indicators commonly displayed by sar or iostat with output from PostgreSQL's process activity view, and presents global and per-process statistics in an easy-to-interpret way.pg_view can be especially helpful when you're monitoring system load, query locks and I/O utilization during lengthy data migrations. It's also useful when you're running servers 24x7 and aiming for zero downtime. Learn more about it at tech.zalando.com.

Tungsten Clustering and Replication

  •    Java

Tungsten is a family of open source technologies for database clustering and replication. Tungsten includes replication, management, SQL routing, and proxying that improve database availability, protect data, and raise application throughput.

mypipe - MySQL binary log consumer with the ability to act on changed rows and publish changes to different systems with emphasis on Apache Kafka

  •    Scala

mypipe latches onto a MySQL server with binary log replication enabled and allows for the creation of pipes that can consume the replication stream and act on the data (primarily integrated with Apache Kafka). mypipe tries to provide enough information that usually is not part of the MySQL binary log stream so that the data is meaningful. mypipe requires a row based binary log format and provides Insert, Update, and Delete mutations representing changed rows. Each change is related back to it's table and the API provides metadata like column types, primary key information (composite, key order), and other such useful information.