The Alertmanager handles alerts sent by client applications such as the Prometheus server. It takes care of deduplicating, grouping, and routing them to the correct receiver integrations such as email, PagerDuty, or OpsGenie. It also takes care of silencing and inhibition of alerts.There are various ways of installing Alertmanager.
monitoring alertmanager pagerduty email notifications opsgenie slack deduplicationAddresses and the locations they represent are essential for any application dealing with maps (place search, transportation, on-demand/delivery services, check-ins, reviews). Yet even the simplest addresses are packed with local conventions, abbreviations and context, making them difficult to index/query effectively with traditional full-text search engines. This library helps convert the free-form addresses that humans use into clean normalized forms suitable for machine comparison and full-text indexing. Though libpostal is not itself a full geocoder, it can be used as a preprocessing step to make any geocoding application smarter, simpler, and more consistent internationally. The core library is written in pure C. Language bindings for Python, Ruby, Go, Java, PHP, and NodeJS are officially supported and it's easy to write bindings in other languages.
address-parser machine-learning nlp address international deduplication record-linkage deduping natural-language-processingrestic is a backup program that is fast, efficient and secure. Restic should be easy to configure and use, so that in the unlikely event of a data loss you can just restore it. It uses cryptography to guarantee confidentiality and integrity of your data.
backup deduplication backup-program restore archiveBorgBackup (short: Borg) is a deduplicating backup program. Optionally, it supports compression and authenticated encryption. The main goal of Borg is to provide an efficient and secure way to backup data. The data deduplication technique used makes Borg suitable for daily backups since only changes are stored. The authenticated encryption technique makes it suitable for backups to not fully trusted targets.
backup backup-restore compression dedupe ssh deduplication encryption backup-toolsSee wiki for current project status. rdedup is a data deduplication engine and a backup software.
data-deduplication backup encryption deduplicationZingg is a scalable fuzzy matching for data mastering, deduplication and entity resolution. Real world data contains multiple records belonging to the same customer. These records can be in single or multiple systems and they have variations across fields which makes it hard to combine them together, especially with growing data volumes. Zingg integrates different records of an entity like customer, patient, supplier, product etc in same or disparate data sources.
data-science identity-resolution spark etl dedupe entity-resolution data-transformation ml fuzzy-matching deduplication masterdata dataengineering fuzzymatch dataquality datapreparation analytics-engineering data-transformationscrudwork is a collection of reuseable components for .NET applications.
address-parser backgroundworker concurrency data-access-layer data-warehouse deduplication disposing-objectKopia is a simple, cross-platform tool for managing encrypted backups in the cloud. It provides fast, incremental backups, secure, client-side encryption and data deduplication.
deduplication backup google-cloud-storage encryption cloudBlobStash is both a content-addressed blob store and a key value store accessible via an HTTP API.Key value pairs are stored as "meta" blobs, this mean you can build application on top of BlobStash without the need for another database.
blob-store backup content-addressed document-store blobstash deduplication storagefindup is quite fast - it is within 2x of the fastest duplicate finders written in C/C++. Based on the V8 profiler output, about 40% of the time is spent on I/O, 13% on crypto and 11% on file traversal, so any further gains in performance will need to come from I/O optimizations rather than code optimizations. BTW, you may notice that file-dedupe defaults to sync I/O. This is because the async I/O seems to have significant overhead for typical FS tasks. You can test this out by passing the --async flag on your system.
dedupe file deduplication duplicate fs hashlieu is a Python library for deduping venues and addresses around the world using libpostal's international street address normalization. Note: libpostal and its Python binding are required to use this library, setup instructions here.
deduplication geocoding address venues internationalA pair of kernel modules which provide pools of deduplicated and/or compressed block storage. VDO (which includes kvdo and vdo) is software that provides inline block-level deduplication, compression, and thin provisioning capabilities for primary storage. VDO installs within the Linux device mapper framework, where it takes ownership of existing physical block devices and remaps these to new, higher-level block devices with data-efficiency capabilities.
kernel-modules storage vdo linux-kernel deduplication compressionA set of userspace tools for managing pools of deduplicated and/or compressed block storage. VDO (which includes kvdo and vdo) is software that provides inline block-level deduplication, compression, and thin provisioning capabilities for primary storage. VDO installs within the Linux device mapper framework, where it takes ownership of existing physical block devices and remaps these to new, higher-level block devices with data-efficiency capabilities.
vdo storage deduplication compressionRewriten to use Python3 (3.2+), new compression methods, snapshots / subvolumes. I know about ZFS and Btrfs. But they are still complicated to use under linux and has disadvantages like need in block device, weak block hash algorithms, very little variants of compression methods.
storage backup fuse compression deduplication python3A FUSE file system built on top of BlobStash with built-in sync and deduplication.
fuse deduplication filesystem blobstashTool to securely push incremental (think "rsync --link-dest") backups to Tahoe Least Authority File System. Note that to install stuff in system-wide PATH and site-packages, elevated privileges are often required. Use "install --user", ~/.pydistutils.cfg or virtualenv to do unprivileged installs into custom paths.
tahoe-lafs backup twisted deduplication compression yaml automationA backup program that does deduplication, compression, encryption. It's based on the ideas of Syncany, but reimplemented in C++, using state of art compression (BSC library), no dependency on anything except libcrypto. It provides a console mode that has been tested on both Linux and MacOSX. It allows saving backups to a remote server that's considered hostile, with no modification to the remote server software required. Because of deduplication, space saving is considerable between backup and in a backup itself. Then even more data is preserved with compression (using either zLib or BSC library), and compressed data is encrypted in local files (or remote files if you mounted then beforehand).
deduplication backup compression encryption c-plus-plus timemachineA work-in-progress to provide a standard interface for deduplication of large databases with custom pre-processing and post-processing steps. In addition to running a database-level deduplication with dedupe, this script adds custom pre- and post-processing steps to improve the run-time and results, making this a hybrid between fuzzy matching and record linkage.
deduplication dedupe data-cleaning record-linkage postgresql databaseTool for managing data-deduplication within extant compressed archive files, with a heavy focus on Manga/Comic-book archive files. This is a rather exotic tool that is intended to allow fairly fast duplicate detection for files within compressed archives.
postgresql image-search deduplication bk-tree cython
We have large collection of open source products. Follow the tags from
Tag Cloud >>
Open source products are scattered around the web. Please provide information
about the open source projects you own / you use.
Add Projects.