Faust is a stream processing library, porting the ideas from Kafka Streams to Python. It is used at Robinhood to build high performance distributed systems and real-time data pipelines that process billions of events every day.
kafka-streams kafka asyncio distributed-systems stream-processingThis project is not actively maintained anymore please see Seldon Core. Seldon Server is a machine learning platform that helps your data science team deploy models into production.
machine-learning deep-learning deployment kubernetes docker microservices spark kafka kafka-streams tensorflow cloud aws gcp azure seldon recommender-system recommendation-engine predictionKafka UI is a UI for Apache Kafka to monitor and manage Apache Kafka clusters. It is a simple tool that makes your data flows observable, helps find and troubleshoot issues faster and deliver optimal performance. Its lightweight dashboard makes it easy to track key metrics of your Kafka clusters - Brokers, Topics, Partitions, Production, and Consumption.
kafka big-data web-ui streams kafka-connect apache-kafka-ui kafka-producer kafka-client kafka-streams hacktoberfest streaming-data kafka-manager kafka-cluster event-streaming cluster-management kafka-brokersSigNoz is an opensource observability platform. SigNoz uses distributed tracing to gain visibility into your systems and powers data using Kafka (to handle high ingestion rate and backpressure) and Apache Druid (Apache Druid is a high performance real-time analytics database), both proven in the industry to handle scale.
metrics prometheus self-hosted tracing stream-processing druid kafka-streams observability distributed-tracing application-monitoring jaegertracing opentelemetry open-telemetry datadog-alternative newrelic-alternativeThis repository contains code examples for Apache Kafka and the Confluent Platform.
confluent kafka kafka-streams kafka-clients example examples demo stream-processing ccloudStrimzi provides a way to run an Apache Kafka cluster on Kubernetes or OpenShift in various deployment configurations. See our website for more details about the project. Documentation to the current master branch as well as all releases can be found on our website.
kafka kubernetes openshift docker messaging enmasse kafka-connect kafka-streams data-streaming data-stream data-streams kubernetes-operator kubernetes-controllerMemgraph is a streaming graph application platform that helps you wrangle your streaming data, build sophisticated models that you can query in real-time, and develop graph applications.
kafka graph graph-algorithms nosql stream-processing graph-database kafka-streams cypher graph-analysis streaming-data opencypherA library that provides an in-memory Kafka instance to run your tests against. As of version 1.1.1 the library is not dependent anymore on ScalaTest and won't transitively bring ScalaTest into your build.
kafka kafka-streams scalatestImplementation of Apache Kafka's Streams API in Python. Apache Kafka is an open-source stream processing platform developed by the Apache Software Foundation written in Scala and Java. Kafka has Streams API added for building stream processing applications using Apache Kafka. Applications built with Kafka's Streams API do not require any setup beyond the provision of a Kafka cluster.
kafka-streams streaming-api librdkafkaLearn Kafka Streams with several examples!
kafka kafka-streams learning udemyDocker images for deploying and running the Confluent Platform. The images are currently available on DockerHub. They are currently only available for Confluent Platform 3.0.1 and after.Full documentation for using the images can be found here.
confluent kafka docker-images kafka-connect kafka-streamsDevelop and deploy Streaming Analytics applications visually with bindings for streaming engine and multiple source/sinks, rich set of streaming operators and operational lifecycle management. Streaming Analytics Manager makes it easy to develop, monitor streaming applications and also provides analytics of data thats being processed by streaming application.
streaming real-time storm spark-streaming kafka kafka-streams flinkThe records provided to the mocked stream will be submitted to the topology during the test in the order in which they appear in the fixture. You can also submit records multiple times to the same topics, at various moments in your scenario. This can be handy to validate that your topology behaviour is or is not dependent on the order in which the records are received and processed.
kafka-streams mocked-streams kafka testing unit-testing topologyThe example application consists of two services written in Scala, an ingestion service (code) and an aggregation service (code). The ingestion service subscribes to the Twitter Streaming API and receives fresh tweets filtered by a list of terms. Any raw tweet is sent to the Kafka topic 'tweets' in JSON. The aggregation service retrieves raw tweets, parses tweets, and aggregates word counts in tumbling time windows, see the code here. Kafka Streams uses an embedded RocksDB for maintaining a local state. Any change to the aggregate will be propagated to the topic 'aggregate'. Both services share the same SBT project, and will be located in the same fat jar including all dependencies. Which allows us to easily share code in this small example project. Both applications access the application.conf in runtime via the Settings object, see code. I wrote a small build script to compile the services, building the Docker images and running the containers.
kafka-streams twitter-streaming-api tweets processing exampleRunning Top N aggregation using Apache Kafka Streams
kafka apache kafka-streams nodejs node express mongodbThis notice will be removed when I believe the API is stable and the library has performed well under heavy loads in real-world use. Kafka Streams is included as a provided dependency, meaning your application will need to include the Kafka Streams JAR as a dependency as well as this library.
kafka kafka-streams transducersTsūjun is yet another Web UI for KSQL. This application is using Fetch API and Fetch API's Readable streams. But in Firefox, this feature disabled by default. It can be enabled in about:config.
ksql kafka kafka-streams-kafkastreamserver - implementation of model scoring and queryable state using Kafka streams Also includes implementation of custom Kafka streams store.
model-serving pmml tensorflow akka-streams akka-http kafka kafka-streams flink spark-streaming spark-mlKafka ecosystem ... but step by step!
kafka kafka-broker zookeeper cdc debezium ksql kafka-streamsThis repository contains code examples for Kafka Streams API.
knoldus sbt kafka apache-kafka kafka-streams examples
We have large collection of open source products. Follow the tags from
Tag Cloud >>
Open source products are scattered around the web. Please provide information
about the open source projects you own / you use.
Add Projects.