brooklin - An extensible distributed system for reliable nearline data streaming at scale

•    Java

Brooklin is a distributed system intended for streaming data between various heterogeneous source and destination systems with high reliability and throughput at scale. Designed for multitenancy, Brooklin can simultaneously power hundreds of data pipelines across different systems and can easily be extended to support new sources and destinations. Brooklin offers a flexible API that can be extended to support a wide variety of source and destination systems. It is not confined to single type of source or destination system.

Debezium - Stream changes from your databases.

•    Java

Debezium is a distributed platform that turns your existing databases into event streams, so applications can see and respond immediately to each row-level change in the databases. Debezium is built on top of Apache Kafka and provides Kafka Connect compatible connectors that monitor specific database management systems. Debezium records the history of data changes in Kafka logs, from where your application consumes them. This makes it possible for your application to easily consume all of the events correctly and completely.

Change Data Capture Helper

•    CSharp

Change data capture helper for SQL Server 2008 It's developed in C#

TomCdc

TomCdc is a solution which makes tracking of sql databse changes easy. Quick and simple installation process allows to start using the solution in just a few minutes. It supports all versions of Microsoft Sql server. You'll no longer have to write triggers manually to find ou...

neo4j-kafka - Neo4j Kafka Integrations

•    Kotlin

Ideas based on a now removed repository from workday. You can set the following configuration values in your neo4j.conf, here are the defaults.

gravity - A Data Replication Center

•    Go

Gravity is used to replicate data between various inputs and outputs (databases, message queues). Special thanks to @dantin, @LiangShang, and @liwink for the early support to this project, and thanks @CaitinChen for the initial translation of the documentation.

dtle - Distributed Data Transfer Service for MySQL

•    Go

dtle is MySQL data transfer/replication tool. Contributions are welcomed and greatly appreciated. See documentation for details on submitting patches and the contribution workflow.

dolphinbeat - A server that pulls and parses MySQL binlog, pushs change data into different sinks like Kafka

•    Go

This is a high available server that pulls MySQL binlog, parses binlog and pushs incremental update data into different sinks. The types of sink supported currently and officially are Kafka and Stdout.

neo4j-streams - Neo4j Kafka Integrations

•    Kotlin

You can set the following configuration values in your neo4j.conf, here are the defaults. See the Apache Kafka documentation for details on these settings.

kafka-streams-playground - Simple application implementing Change Data Capture using Kafka Streams.

•    Scala

I developed this simple application to experiment with Kafka Streams. The objective has been to implement the Change Data Capture (CDC) pattern using MongoDB, Kafka Streams, and Elasticsearch. The use case is depicted in the following diagram.

scylla-cdc-source-connector - A Kafka source connector capturing Scylla CDC changes

•    Java

Kafka Connect Source Connector from Scylla CDC.