syslog-gollector - Syslog Collector written in Go, streams to Kafka 0.8

  •        2

Detailed background on syslog-gollector can be found on these blog posts. syslog-gollector is a Syslog Collector (sometimes called a Syslog Server), written in Go (golang), which has support for writing received log messages to Apache Kafka, version 0.8. Log messages can be written to Kafka in parsed format, or written exactly as received.

http://www.philipotoole.com/tag/syslog-gollector/
https://github.com/otoolep/syslog-gollector

Tags
Implementation
License
Platform

   




Related Projects

syslog-ng - syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, queueing, SQL & NoSQL

  •    C

syslog-ng is an enhanced log daemon, supporting a wide range of input and output methods: syslog, unstructured text, message queues, databases (SQL and NoSQL alike), and more. For a brief introduction to configuring the syslog-ng application, see the quickstart guide.

nxlog - Multi platform Log management

  •    C

nxlog is a modular, multi-threaded, high-performance log management solution with multi-platform support. In concept it is similar to syslog-ng or rsyslog but is not limited to unix/syslog only. It can collect logs from files in various formats, receive logs from the network remotely over UDP, TCP or TLS/SSL . It supports platform specific sources such as the Windows Eventlog, Linux kernel logs, Android logs, local syslog etc.

nxlog

  •    C

A multi-platform universal log collector and forwarder

liblogfaf - A library that logs messages using non-blocking UDP datagrams.

  •    C

liblogfaf (faf stands for fire-and-forget) is a dynamic library that is designed to be LD_PRELOAD-ed while starting a process that uses openlog() & syslog() functions to send syslog messages. It overrides logging functions to make log messages sent as UDP datagrams instead of getting written to /dev/log (which can block). This is useful for processes that call syslog() as part of their main execution flow and can therefore be easily broken when /dev/log buffer gets full, for example when the process that is expected to read from it (usually system syslog daemon like rsyslog or syslog-ng) stops doing that.Please note that liblogfaf should not be used in an environment where reliable log message delivery is required.

ekanite - The Syslog server with built-in search

  •    Go

For detailed look at the goals, design, and implementation of this project, check out these blog posts. Ekanite is a high-performance syslog server with built-in text search. Its goal is to do a couple of things, and do them well -- accept log messages over the network, and make it easy to search the messages. What it lacks in feature, it makes up for in focus. Built in Go, it has no external dependencies, which makes deployment easy.


liblogfaf - A library that logs messages using non-blocking UDP datagrams.

  •    C

liblogfaf (faf stands for fire-and-forget) is a dynamic library that is designed to be LD_PRELOAD-ed while starting a process that uses openlog() & syslog() functions to send syslog messages. It overrides logging functions to make log messages sent as UDP datagrams instead of getting written to /dev/log (which can block). This is useful for processes that call syslog() as part of their main execution flow and can therefore be easily broken when /dev/log buffer gets full, for example when the process that is expected to read from it (usually system syslog daemon like rsyslog or syslog-ng) stops doing that. Please note that liblogfaf should not be used in an environment where reliable log message delivery is required.

Epylog - a Syslog parser

  •    Python

Epylog is a syslog parser which runs periodically, looks at your logs, processes some of the entries in order to present them in a more comprehensible format, and then mails you the output. It is written specifically for large network clusters where a lot of machines (around 50 and upwards) log to the same loghost using syslog or syslog-ng.

syslog replacement - rsyslog

  •    C

A syslogd supporting on-demand disk buffering, TCP, writing to databases, configurable output formats, high-precision timestamps, filtering on any syslog message part, on-the-wire message compression, and the ability to convert text files to syslog.

remote_syslog2 - To install, see "Releases" tab

  •    Go

remote_syslog tails one or more log files and sends syslog messages to a remote central syslog server. It generates packets itself, ignoring the system syslog daemon, so its configuration doesn't affect system-wide logging. This code is tested with the hosted log management service Papertrail and should work for transmitting to any syslog server.

rsyslog - a Rocket-fast SYStem for LOG processing

  •    C

Rsyslog is a rocket-fast system for log processing. It offers high-performance, great security features and a modular design. While it started as a regular syslogd, rsyslog has evolved into a kind of swiss army knife of logging, being able to accept inputs from a wide variety of sources, transform them, and output to the results to diverse destinations.

Sherlock

  •    Java

Distributed Syslog collector and viewer system with reliable Syslog msgs over tcp, and query with reg ex. using PERL. Supports IETF syslog and syslog relay, JAVA/JINI based, uses postgreSQL, JBOSS. Chain of custody raw to db data link. UTF8, D, F , UK

Syslog Backup Scripts

  •    Perl

This project contains the PERL scripts, which can rearrange the logs from /var/log/messages and insert in to the database. Scripts can also separate logs for each syslog clients as well as for each application of syslog client.

syslog-ng

  •    

syslog-ng is a syslogd replacement supporting IPv6 and capable of transferring log messages reliably using TCP and filtering the content of messages using regular expressions.

LogZilla is Syslog Management

  •    PHP

NOTE: This Project is deprecated. php-syslog-ng is now known as LogZilla and can be found at http://www.logzilla.pro

Free Windows Network User Accounting

  •    Perl

FWNUA (Free Windows Network User Accounting) runs silently in a Windows login script and collects data about user logins. It allows more freedom in standardized computer naming. FWNUA keeps track of the workstations so you don't have to! FWNUA now supports syslog and Splunk! A fork of the current 3.0 version can now be downloaded. Look for the fwnua - syslog in the files list. Use Splunk or your own syslog server with data mining tools to create a robust user tracking system.

Event Log to SysLog

  •    CSharp

el2sl mean Event Lot to SysLog. This program start as windows service and send windows event logs to syslog server over network. Source code avialable on github: https://github.com/Sheridan/el2sl

Syslog SQL Daemon

  •    

A syslog daemon that runs as a Windows Service and logs incoming syslog traffic to a database on Microsoft SQL Server.

Syslog Collector

  •    Python

Syslog Collector listen for syslog messages and parse them following some regular expressions. It then increment some counters which are exposed through SNMP Agent-X interface

ida-syslog

  •    Javascript

A Web-based Viewer for Syslog Data. Requires Syslog in MySQL Database. Ajax based on jQuery and PHP.

liblogging

  •    C

Liblogging is an easy to use open source library for system logging. It support various RFC for syslog reporting, most notably RFC 3195 for reliable delivery of syslog messages. Liblogging has an easy to use client and server side interface.