We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.
Meniscus - The Python Event Logging Service
- 3315
Meniscus is a Python based system for event collection, transit and processing in the large. It's primary use case is for large-scale Cloud logging, but can be used in many other scenarios including usage reporting and API tracing. Its components include Collection, Transport, Storage, Event Processing & Enhancement, Complex Event Processing, Analytics.
http://projectmeniscus.org/https://github.com/ProjectMeniscus/meniscus
| Tags | log-analysis event-processing events logs syslog |
| Implementation | Python |
| License | Apache |
| Platform | Windows Linux |
Related Projects
nxlog - Multi platform Log management
nxlog is a modular, multi-threaded, high-performance log management solution with multi-platform support. In concept it is similar to syslog-ng or rsyslog but is not limited to unix/syslog only. It can collect logs from files in various formats, receive logs from the network remotely over UDP, TCP or TLS/SSL . It supports platform specific sources such as the Windows Eventlog, Linux kernel logs, Android logs, local syslog etc.
log syslog log-management log-analysis log-serverFluentd - Data collector, Log Everything in JSON
Fluentd is an event collector system. It is a generalized version of syslogd, which handles JSON objects for its log messages. It collects logs from various data sources and writes them to files, database or other types of storages.
log-collector syslog log-analysis log log-managementZenoss - Open Source IT Management
Zenoss Core is an open source IT monitoring product that delivers the functionality to effectively manage the configuration, health, performance of networks, servers and applications through a single, integrated software package.
monitoring sys-admin-tools tools system-monitoring log-analysisDAD - Log aggregation, analysis, alerting and correlation for Windows, Syslog and text based logs.
Log aggregation, analysis, alerting and correlation for Windows, Syslog and text based logs.
Event Log Analyzer
Event Log Analyzer is a simple yet powerful tool to analyze event logs in Windows. It has features to group similar events together, give graphical view of distribution of events over time and in similarity. It is developed in C# and WPF and uses MVVM framework.
analyzer event-log-analyzer event-logs wpf-mvvmEpylog - a Syslog parser
Epylog is a syslog parser which runs periodically, looks at your logs, processes some of the entries in order to present them in a more comprehensible format, and then mails you the output. It is written specifically for large network clusters where a lot of machines (around 50 and upwards) log to the same loghost using syslog or syslog-ng.
log log-analysis log-managementEvent Log to SysLog
el2sl mean Event Lot to SysLog. This program start as windows service and send windows event logs to syslog server over network. Source code avialable on github: https://github.com/Sheridan/el2sl
Graylog2 - Open Source Log Management
Graylog2 is an open source log management solution that stores your logs in ElasticSearch. It consists of a server written in Java that accepts your syslog messages via TCP, UDP or AMQP and stores it in the database. The second part is a web interface that allows you to manage the log messages from your web browser. Take a look at the screenshots or the latest release info page to get a feeling of what you can do with Graylog2.
log log-analysis log-search log-management syslog100Projects - 100 Projects to be completed, for me its in Python
**Mp3 Tagger** – Modify and add ID3v1 tags to MP3 files. See if you can also add in the album art into the MP3 file’s header as well as other ID3v2 tags.**Log File Maker** – Make an application which logs various statistics in response to given events. This can be something that logs what an application does, what the system is doing, when something like a file changes etc.**Excel Spreadsheet Exporter** – Create an online application which can read in a file and create an Excel Spreadshe
Octopussy - Perl/XML Logs Analyzer, Alerter & Reporter
Octopussy is a Log analyzer tool. It analyzes the log, generates reports and alerts the admin. It has LDAP support to maintain users list. It exports report by Email, FTP & SCP. Scheduled reports could be generated. RRD tool to generate graphs.
log log-analysis log-management rrdtoolWindows Event Log Manager
Windows Event Log Manager is a tool for creating, editing, and viewing windows event logs.
event-log events log windowsliblogfaf - A library that logs messages using non-blocking UDP datagrams.
liblogfaf (faf stands for fire-and-forget) is a dynamic library that is designed to be LD_PRELOAD-ed while starting a process that uses openlog() & syslog() functions to send syslog messages. It overrides logging functions to make log messages sent as UDP datagrams instead of getting written to /dev/log (which can block). This is useful for processes that call syslog() as part of their main execution flow and can therefore be easily broken when /dev/log buffer gets full, for example when the process that is expected to read from it (usually system syslog daemon like rsyslog or syslog-ng) stops doing that.Please note that liblogfaf should not be used in an environment where reliable log message delivery is required.
ceplog - Log data analysis using Esper (complex event processing framework)
Log data analysis using Esper (complex event processing framework)
qiao - Reliable Log Streamer
Qiao (橋, the Chinese character for “bridge”, pronounced as Chiao) is a standalone service that streams event data from a log in real-time and delivers them to one or more destinations. Similar to Unix 'tail -F' command, Qiao keeps following a log file when it rotates. One notable difference of Qiao from other log streamers is that Qiao keeps track of read-cursor position and stores the offset on the disk efficiently. In the event that the agent restarts, Qiao is able to continue processing at the file position where it left off before it terminated even if the file was rotated out. Furthermore, for a space-conscious log producer, Qiao can process logs in a compacted binary format, in addition to regular text format (a single ‘line’ of text followed by line feed (‘\n’)). Qiao also supports Avro format out of box.
windows-event-forwarding - A repository for using windows event forwarding for incident detection and response
Over the past few years, Palantir has a maintained an internal Windows Event Forwarding (WEF) pipeline for generating and centrally collecting logs of forensic and security value from Microsoft Windows hosts. Once these events are collected and indexed, alerting and detection strategies (ADS) can be constructed not only on high-fidelity security events (e.g. log deletion), but also for deviations from normalcy, such as unusual service account access, access to sensitive filesystem or registry locations, or installation of malware persistence.The goal of this project is to provide the necessary building blocks for organizations to rapidly evaluate and deploy WEF to a production environment, and centralize public efforts to improve WEF subscriptions and encourage adoption. While WEF has become more popular in recent years, it is still dramatically underrepresented in the community, and it is our hope that this project may encourage others to adopt it for incident detection and response purposes. We acknowledge the efforts that Microsoft, IAD, and other contributors have made to this space and wish to thank them for providing many of the subscriptions, ideas, and techniques that will be covered in this post.
Webalizer - fast web server log file analysis
The Webalizer is a fast web server log file analysis program. It produces highly detailed, easily configurable usage reports in HTML format, for viewing with a standard web browser. It handles standard Common logfile format (CLF) server logs, several variations of the NCSA Combined logfile format, wu-ftpd/proftpd xferlog (FTP) format logs, Squid proxy server native format, and W3C Extended log formats.
web-analytics web-traffic google-analytics-alternative log log-analysisProject Lasso
Project Lasso is Windows-based open source software designed to collect Windows event logs, including custom application logs, and provide central collection and transport of Windows log data via UDP/TCP syslog.
funnel - A minimalistic 12 factor log router written in Go
The 12 factor rule for logging says that an app "should not attempt to write to or manage logfiles. Instead, each running process writes its event stream, unbuffered, to stdout." The execution environment should take care of capturing the logs and perform further processing with it. Funnel is this "execution environment".All you have to do from your app is to print your log line to stdout, and pipe it to funnel. You can still use any logging library inside your app to handle other stuff like log level, structured logging etc. But don't bother about the log destination. Let funnel take care whether you want to just write to files or stream your output to Kafka. Think of it as a fluentd/logstash replacement(with minimal features!) but having only stdin as an input.
log-rotation log-stream log-routergocells - Tideland Go Cells
The Tideland Go Cells provide a package for the creation of event based applications with networked concurrently working cells. The way how they process the recevied events is defined by behaviors. During the processing of an event a cell can emit multiple events to its subscribers.Major package providing the infrastructure for event based applications. It is organized as an environment of networked cells. Each cell is controlled by its behavior implementing the according interface. It receives events, processes them, and can emit a number of new events during this time. Those events are then received by those cells which subscribed to the individual cell.
tideland eda cep event-driven event-stream event-processing library