librdkafka - The Apache Kafka C/C++ library

•    C

---

Copyright (c) 2012-2016, Magnus Edenhill.librdkafka is a C library implementation of the Apache Kafka protocol, containing both Producer and Consumer support. It was designed with message delivery reliability and high performance in mind, current figures exceed 1 million msgs/second for the producer and 3 million msgs/second for the consumer.

kafka kafka-consumer apache-kafka high-performance librdkafka kafka-producer c-plus-plus consumer kafka-client kafka-library

cds - Data syncing in golang for ClickHouse.

•    Go

---

Data syncing in golang for ClickHouse. Automatically synchronizing data from MySQL/MongoDB data source to ClickHouse cluster in real time.

clickhouse bigdata kafka-consumer

karafka - Framework used to simplify Apache Kafka based Ruby and Rails applications development.

•    Ruby

---

Framework used to simplify Apache Kafka based Ruby applications development.It allows programmers to use approach similar to standard HTTP conventions (params and params_batch) when working with asynchronous Kafka messages.

karafka-framework kafka-topic kafka kafka-client kafka-clients kafka-producer kafka-consumer apache-kafka kafka-message karafka-application sidekiq rails kafka-ruby ruby-on-rails rubygems rubygem ruby-library kafka-library

kq - Kafka-based Job Queue for Python

•    Python

---

KQ (Kafka Queue) is a lightweight Python library which lets you queue and execute jobs asynchronously using Apache Kafka. It uses kafka-python under the hood. You may need to use sudo depending on your environment.

kafka job-queue async kafka-client kafka-consumer kafka-producer python3 python2 python-library python-3 python-2 asynchronous queueing jobqueue apache-kafka worker-queue producer-consumer serialization python-3-5

racecar - Racecar: a simple framework for Kafka consumers in Ruby

•    Ruby

---

Using ruby-kafka directly can be a challenge: it's a flexible library with lots of knobs and options. Most users don't need that level of flexibility, though. Racecar provides a simple and intuitive way to build and configure Kafka consumers that optionally integrates seamlessly with Rails.This will add a config file in config/racecar.yml.

rails kafka kafka-consumer kafka-client kafka-library

rafka - Interact with Kafka in a simple way

•    Go

---

Rafka is a gateway service that exposes Kafka using simple semantics. It implements the Redis protocol.

kafka kafka-consumer kafka-producer librdkafka kafka-client

kafka-influxdb - High performance Kafka consumer for InfluxDB. Supports collectd message formats.

•    Python

---

A Kafka consumer for InfluxDB written in Python. Supports InfluxDB 0.9.x and up. For InfluxDB 0.8.x support, check out the 0.3.0 tag. Kafka will serve as a buffer for your metric data during high load. Also it's useful for sending metrics from offshore data centers with unreliable connections to your monitoring backend.

kafka-influxdb kafka-consumer logstash influxdb producer consumer performance

reactive-interaction-gateway - Your UI deserves an API, too!

•    Elixir

---

In short: handling asynchronous events. Instead, let RIG handle those connections for you. RIG is designed for scalability and allows you to concentrate on the actual business logic. Back-end (micro)services no longer have to care about connection state, which means they can be stateless, making it very easy to roll out updates to them. Sending notifications to all online devices of a certain user becomes as easy as POSTing a message to an HTTP endpoint.

elixir elixir-phoenix elixir-apps api-gateway kafka-consumer kafka-producer server-sent-events unidirectional-data-flow reactive frontend polling architecture

strimzi-kafka-bridge - Apache Kafka bridge

•    Java

---

Apache Kafka bridge

amqp bridge kafka kafka-bridge http kafka-consumer kafka-producer kafka-rest-proxy kafka-client amqp-client amqp10

kafka-0.11-examples - Code snippets that demonstrate how to leverage the new Kafka 0.11 APIs

•    Scala

---

This repository contains code snippets in Scala, using the Java clients, that demonstrate how to use the Kafka 0.11 new APIs. The code is incomplete, and that's intended: the goal is to bring the focus on the new APIs only.

kafka kafka-client kafka-producer kafka-consumer

kafka-examples - Examples of use of Apache Kafka Clients/KafkaStreams APIs

•    Java

---

This repository contains small examples demonstrating Producer/Consumer API and Kafka Streams features. Complete example demonstrating how to implement a failover mechanism using the Callback interface in order to don't loss any record even in case of cluster failure.

kafka kafka-client kafka-consumer kafka-producer kafka-examples

kafkabridge - The Apache Kafka Client SDK

•    C++

---

Navigate to the cxx/c installation directory，and run build.sh -release, you will get a new file named libqbus.so in the "./lib/release" directory. Navigate to the Go installation directory，and run build.sh, you will get the new files qbus.go and libQBus_go.so in the directory "gopath/src/qbus".

kafka consumer producer kafkaclient kafkasdk cplusplus kafkabridge kafka-producer kafka-consumer

go-graphql-subscription-example - ☝️ go-graphql subscription over Kafka/Redis/NSQ example

•    Go

---

Project that demonstrates graphQL subscriptions (over Websocket) to consume pre-configured topics from different kinds of stream sources like Apache Kafka, redis, NSQ... This repository implements a simple service allowing clients to consume messages from a topics/channels through a graphQL subscription endpoint.

graphql redis events reactivex kafka event-stream websocket prometheus graphql-subscriptions nsq kafka-consumer