lz4 - Extremely Fast Compression algorithm

•    C

---

LZ4 is lossless compression algorithm, providing compression speed at 400 MB/s per core, scalable with multi-cores CPU. It features an extremely fast decoder, with speed in multiple GB/s per core, typically reaching RAM speed limits on multi-core systems.Speed can be tuned dynamically, selecting an "acceleration" factor which trades compression ratio for more speed up. On the other end, a high compression derivative, LZ4_HC, is also provided, trading CPU time for improved compression ratio. All versions feature the same decompression speed.

lz4 compression

MessagePack-CSharp - Extremely Fast MessagePack Serializer for C#(

•    CSharp

---

Extremely fast MessagePack serializer for C#, x10 faster than MsgPack-Cli and acquires best performance compared with all the other C# serializers. MessagePack for C# has built-in LZ4 compression which can achieve super fast and small binary size. Performance is always important! for Game, Distributed computing, Microservices, Store data to Redis, etc.MessagePack has compact binary size and full set of general purpose expression. Please see the comparison with JSON, protobuf, ZeroFormatter section. If you want to know why MessagePack C# is fastest, please see performance section.

messagepack unity serialization xamarin c-sharp msgpack lz4

archiver - Easily create and extract

•    Go

---

Package archiver makes it trivially easy to make and extract common archive formats such as .zip, and .tar.gz. Simply name the input and output file(s).Files are put into the root of the archive; directories are recursively added, preserving structure.

tar extract bz2 zip gzip xz rar lz4

Libarchive - C library and command-line tools for reading and writing tar, cpio, zip, ISO, and other

•    C

---

The libarchive project develops a portable, efficient C library that can read and write streaming archives in a variety of formats. It also includes implementations of the common tar, cpio, and zcat command-line tools that use the libarchive library.

zip compression archive bzip2 library tar gzip lzip lz4

7-Zip-zstd - 7-Zip with support for Brotli, Fast-LZMA2, Lizard, LZ4, LZ5 and Zstandard

•    C

---

Zstandard v1.3.7 is a real-time compression algorithm, providing high compression ratios. It offers a very wide range of compression / speed trade-off, while being backed by a very fast decoder. Brotli v.1.0.7 is a generic-purpose lossless compression algorithm that compresses data using a combination of a modern variant of the LZ77 algorithm, Huffman coding and 2nd order context modeling, with a compression ratio comparable to the best currently available general-purpose compression methods. It is similar in speed with deflate but offers more dense compression.

brotli lizard lz4 lz5 zstd zstandard 7-zip compression archiver 7z

Snappy for .NET

•    

---

.NET P/Invoke wrapper for Snappy, fast compression library

compression fast lz4 snappy wrapper

node-lz4 - LZ4 fast compression algorithm for NodeJS

•    Javascript

---

LZ4 is a very fast compression and decompression algorithm. This nodejs module provides a Javascript implementation of the decoder as well as native bindings to the LZ4 functions. Nodejs Streams are also supported for compression and decompression. NB. Version 0.2 does not support the legacy format, only the one as of "LZ4 Streaming Format 1.4". Use version 0.1 if required.

js lz4 lz4-frame compression decompression stream

lizard - Lizard (formerly LZ5) is an efficient compressor with very fast decompression

•    C

---

Lizard library is based on frequently used LZ4 library by Yann Collet but the Lizard compression format is not compatible with LZ4. Lizard library is provided as open-source software using BSD 2-Clause license. The high compression/decompression speed is achieved without any SSE and AVX extensions. The following results are obtained with lzbench and -t16,16 using 1 core of Intel Core i5-4300U, Windows 10 64-bit (MinGW-w64 compilation under gcc 6.2.0) with silesia.tar which contains tarred files from Silesia compression corpus.

compression compressor fast decompression-speed lz4 brotli zlib efficient zstd

lz4.js - lz4 for browser

•    Javascript

---

compress to a lz4 buffer. decompress a lz4 buffer.

lz4

lz4 - LZ4 compression and decompression in pure Go

•    Go

---

LZ4 compression and decompression in pure Go. Package lz4 implements reading and writing lz4 compressed data (a frame), as specified in http://fastcompression.blogspot.fr/2013/04/lz4-streaming-format-final.html. Although the block level compression and decompression functions are exposed and are fully compatible with the lz4 block format definition, they are low level and should not be used directly.

lz4 lz4-frame

lz4-wasm - LZ4 block format encoder/decoder: a WebAssembly implementation

•    WebAssembly

---

LZ4 block codec: A WebAssembly implementation. The current implementation encode/decode LZ4 block format as per official documentation.

lz4 webassembly compression

TurboBench - Compression Benchmark

•    C

---

CPU: Sandy bridge i7-2600k at 4.4GHz, gcc 6.3, single thread.

data-compression benchmark bwt lz77 zlib zstd lz4 brotli lzturbo compressor-benchmark lzma entropy-coder huffman range-coder asymmetric-numeral-systems compressor compression zip gzip codec

lzbench - lzbench is an in-memory benchmark of open-source LZ77/LZSS/LZMA compressors

•    C

---

lzbench is an in-memory benchmark of open-source LZ77/LZSS/LZMA compressors. It joins all compressors into a single exe. At the beginning an input file is read to memory. Then all compressors are used to compress and decompress the file and decompressed file is verified. This approach has a big advantage of using the same compiler with the same optimizations for all compressors. The disadvantage is that it requires source code of each compressor (therefore Slug or lzturbo are not included). To remove one of compressors you can add -DBENCH_REMOVE_XXX to DEFINES in Makefile (e.g. DEFINES += -DBENCH_REMOVE_LZ4 to remove LZ4). You also have to remove corresponding *.o files (e.g. lz4/lz4.o and lz4/lz4hc.o).

compressor compression benchmark benchmarking zstd zlib brotli lz4