Displaying 1 to 12 from 12 results

Loki - Multi-tenant log aggregation system inspired by Prometheus

  •    Go

Loki is a horizontally-scalable, highly-available, multi-tenant log aggregation system inspired by Prometheus. It is designed to be very cost effective and easy to operate. It does not index the contents of the logs, but rather a set of labels for each log stream. It is especially good fit for storing Kubernetes Pod logs. Metadata such as Pod labels is automatically scraped and indexed. By storing compressed, unstructured logs and only indexing metadata, Loki is simpler to operate and cheaper to run.

Flume - Log management using HDFS

  •    Java

Flume is a distributed, reliable, and available service for efficiently collecting, aggregating, and moving large amounts of log data. It has a simple and flexible architecture based on streaming data flows. It is robust and fault tolerant with tunable reliability mechanisms and many failover and recovery mechanisms. It uses a simple extensible data model that allows for online analytic application.

Fluentd - Unified Logging Layer

  •    Ruby

Fluentd collects events from various data sources and writes them to files, RDBMS, NoSQL, IaaS, SaaS, Hadoop and so on. Fluentd helps you unify your logging infrastructure. Fluentd can be used to tail access/error logs and transport them reliably to remote systems. It can "grep" for events and send out alerts. It can function as middleware to enable asynchronous, scalable logging for user action events.

logger_json - JSON console backend for Elixir Logger.

  •    Elixir

JSON console back-end for Elixir Logger. It can be used as drop-in replacement for default :console Logger back-end in cases where you use use Google Cloud Logger or other JSON-based log collectors.

dlog - Go library to parse the Docker Logs stream

  •    Go

Go library to parse the binary Docker Logs stream into plain text. dlog offers a single method: NewReader(r io.Reader) io.Reader. You are supposed to give the response body of the /containers/<id>/logs. The returned reader strips off the log headers and just gives the plain text to be used.

agent - 🌲 Highly efficient agent that streams logs (files and STDIN) to your Timber account.

  •    Go

The Timber Agent is a cross-platform natively-compiled utility for capturing log data (file & STDIN) and sending it to Timber.io. It is designed to be light weight, highly efficient, and reliable without the need for dependencies. All releases can be found here. Special URLs that point to the current releases can be found here.

logpeck - Simple, RESTful Log Collector

  •    Go

Logpeck aims to be an easy-to-use module that parsing and collecting contents from log file and posting into specific storage system, such as ElasticSearch, Influxdb, Kafka. We want to control collection tasks remotely with HTTP API (NONE configuration file). We highly recommend to install logpeck-kibana-plugin into Kibana. With this plugin, we can control all machines and collection tasks conveniently. At the same time, we can take advantage of powerful searching and visualization features of Kibana.

HTTPDataCollectorAPI - Azure Log Analytics HTTP Data Collector API wrapper

  •    CSharp

This package is a .Net adaptation of the Powershell code for implementing the HTTP Collector API for Azure Log Analytics as seen on the announcement. You can obtain this project as a Nuget Package.

LogESP - Open Source SIEM (Security Information and Event Management system).

  •    Python

LogESP is a SIEM (Security Information and Event Management system) written in Python Django. It features a web frontend, and handles log management and forensics, risk management, and asset management. LogESP was designed and built as a security application, and minimalism can be good for security.

siemstress - Very basic CLI SIEM (Security Information and Event Management system).

  •    Python

Siemstress is a lightweight but powerful security information and event management (SIEM) system. It uses a database and a suite of CLI tools for managing log events, and automating event analysis. It comes with four programs: siemparse, siemquery, siemtrigger, and siemmanage. Siemstress is designed to parse data, and organize it into prioritized, manageable streams of relevant information. The goal is a streamlined open source information management system that embodies unix design principles. It should be simple, modular, and useful beyond its original scope.

We have large collection of open source products. Follow the tags from Tag Cloud >>

Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.