logstash-output-clickhouse - Implementation of ClickHouse output for logstash

  •        380

This plugin is a modified version of the Lucidworks logstash json_batch. That plugin is available here. It has been modified to support ClickHouse JSON Format, but also supports fault tolerance.

https://github.com/mikechris/logstash-output-clickhouse

Tags
Implementation
License
Platform

   




Related Projects

logstash-logger - Ruby logger that writes logstash events

  •    Ruby

LogStashLogger extends Ruby's Logger class to log directly to Logstash. It supports writing to various outputs in logstash JSON format. This is an improvement over writing to a file or syslog since Logstash can receive the structured data directly. You can use a URI to configure your logstash logger instead of a hash. This is useful in environments such as Heroku where you may want to read configuration values from the environment. The URI scheme is type://host:port/path?key=value. Some sample URI configurations are given below.

logstash-logback-encoder - Logback encoder which creates JSON for use with Logstash

  •    Java

Logback encoder which will output events as Logstash-compatible JSON

hangout - 用java实现一下Logstash的几个常用input/filter/output, 希望能有效率上面的大提升

  •    Java

模仿logstash做的一个应用. 现在我们迁移到了 https://github.com/childe/gohangout , 这个项目基本上停止更新了. 我们一直用logstash从Kafka消费数据进ES, 随着数据量的越来越大, 需要的logstash实例和机器也越来越多.

puppet-logstash - Puppet module to manage Logstash

  •    Puppet

A Puppet module for managing and configuring Logstash.This module, "elastic/logstash" supports only Logstash 5.x. For earlier Logstash versions, support is provided by the legacy module, "elasticsearch/logstash".

logspout-logstash - A minimalistic adapter for github.com/gliderlabs/logspout to write to Logstash

  •    Go

in modules.go. Use by setting a docker environment variable ROUTE_URIS=logstash://host:port to the Logstash server. The default protocol is UDP, but it is possible to change to TCP by adding +tcp after the logstash protocol when starting your container.


logstash - Logstash - transport and process your logs, events, or other data

  •    Ruby

Logstash is part of the Elastic Stack along with Beats, Elasticsearch and Kibana. Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to your favorite "stash." (Ours is Elasticsearch, naturally.). Logstash has over 200 plugins, and you can write your own very easily as well.The license is Apache 2.0, meaning you are pretty much free to use it however you want in whatever way.

docker-logstash - Docker image for Logstash 1.4

  •    Shell

This is a highly configurable logstash (1.4.5) image running Elasticsearch (1.7.0) and Kibana (3.1.2). Any files in /opt/logstash/conf.d with the .conf extension will get loaded by logstash.

node-logstash - Simple logstash implmentation in nodejs : file log collection, sent with zeromq

  •    Javascript

It's a NodeJS implementation of Logstash. node-logstash is a tool to collect logs on servers. It allows sending its logs to a central server and to ElasticSearch for indexing.

logstash-input-jdbc - Logstash Plugin for JDBC Inputs

  •    Ruby

This is a plugin for Logstash. It is fully free and fully open source. The license is Apache 2.0, meaning you are pretty much free to use it however you want in whatever way.

logstash-forwarder - An experiment to cut logs in preparation for processing elsewhere

  •    Go

The filebeat project replaces logstash-forwarder. Please use that instead.If you have questions and cannot find answers, please join the #logstash irc channel on freenode irc or ask on the logstash-users@googlegroups.com mailing list.

HELK - The Incredible HELK

  •    Shell

A Hunting ELK (Elasticsearch, Logstash, Kibana) with advanced analytic capabilities.At the end of the HELK installation, you will have a similar output with the information you need to access the primary HELK components. Remember that the default username and password for the HELK are helk:hunting.

logstasher - Awesome rails logs

  •    Ruby

Update: Logstash now includes Kibana build in, so no need to separately install. Logstasher has been tested with logstash version 1.4.2 with file input and json codec. By default, the older format rails request logs are disabled, though you can enable them.

logstash - logstash - logs/event transport, processing, management, search.

  •    Ruby

logstash - logs/event transport, processing, management, search.

chef-logstash - Semi-official Logstash cookbook

  •    Ruby

This is the semi-official 'all-in-one' Logstash cookbook. This cookbook is primarily a library cookbook.

elk-docker - Elasticsearch, Logstash, Kibana (ELK) Docker image

  •    Shell

This Docker image provides a convenient centralised log server and log management web interface, by packaging Elasticsearch, Logstash, and Kibana, collectively known as ELK. See the ELK Docker image documentation web page for complete instructions on how to use this image.

VulnWhisperer - Create actionable data from your Vulnerability Scans

  •    Python

VulnWhisperer is a vulnerability data and report aggregator. VulnWhisperer will pull all the reports and create a file with a unique filename which is then fed into logstash. Logstash extracts data from the filename and tags all of the information inside the report (see logstash_vulnwhisp.conf file). Data is then shipped to elasticsearch to be indexed. The following instructions should be utilized as a Sample Guide in the absence of an existing ELK Cluster/Node. This will cover a Debian example install guide of a stand-alone node of Elasticsearch & Kibana.

journalbeat - Journalbeat is a log shipper from systemd/journald to Logstash/Elasticsearch

  •    Go

Journalbeat is the Beat used for log shipping from systemd/journald based Linux systems. It follows the system journal very much like journalctl -f and sends the data to Logstash/Elasticsearch (or whatever you configured for your beat). Journalbeat is targeting pure systemd distributions like CoreOS, Atomic Host, or others. There are no intentions to add support for older systems that do not use journald.

logstash-patterns-core

  •    Ruby

This is a plugin for Logstash. It is fully free and fully open source. The license is Apache 2.0, meaning you are pretty much free to use it however you want in whatever way.

Search Guard - Elasticsearch plugin that offers encryption, authentication, and authorisation

  •    Java

Search Guard is an Elasticsearch plugin that offers encryption, authentication, and authorization. It builds on Search Guard SSL and provides pluggable authentication and authorization modules in addition. Search Guard is fully compatible with Kibana, Logstash and Beats.