smart_open - Utils for streaming large files (S3, HDFS, gzip, bz2...)

•    Python

---

There are a few optional keyword arguments that are useful only for S3 access. These are both passed to boto.s3_connect() as keyword arguments. The S3 reader supports gzipped content, as long as the key is obviously a gzipped file (e.g. ends with ".gz").

s3 hdfs webhdfs boto streaming file streaming-data gzip-stream bz2

archiver - Easily create and extract

•    Go

---

Package archiver makes it trivially easy to make and extract common archive formats such as .zip, and .tar.gz. Simply name the input and output file(s).Files are put into the root of the archive; directories are recursively added, preserving structure.

tar extract bz2 zip gzip xz rar lz4

file-type - Detect the file type of a Buffer/Uint8Array

•    Javascript

---

The file type is detected by checking the magic number of the buffer.Show your support for this module by buying this excellent Node.js course.

nodejs uint8array buffer magic-numbers file magic file-types detect mime type archive image img pic picture flash photo video check is exif exe binary jpg png gif webp flif cr2 tif bmp jxr psd zip tar rar gz bz2 7z dmg mp4 m4v mid mkv webm mov avi mpg mp3 m4a ogg opus flac wav amr pdf epub mobi swf rtf woff woff2 eot ttf otf ico flv ps xz sqlite xpi cab deb ar rpm z lz msi mxf mts wasm webassembly blend bpg docx pptx xlsx 3gp jp2 jpm jpx mj2 aif odt ods odp xml

archive-type - Detect the archive type of a Buffer/Uint8Array

•    Javascript

---

Or null when no match.It only needs the first 262 bytes.

7zip archive buffer bz2 bzip2 check detect gz gzip mime rar zip file type

decompress - Extracting archives made easy

•    Javascript

---

See decompress-cli for the command-line version.File to decompress.

extract decompress zip tar targz nodejs bz2 bzip2 tar.bz tar.gz unzip

gulp-decompress - Extract TAR, TAR.BZ2, TAR.GZ and ZIP archives

•    Javascript

---

Extract TAR, TAR.BZ2, TAR.GZ and ZIP archives

bz2 bzip2 decompress extract gulpplugin tar tar.bz tar.gz unzip zip

unbzip2-stream - streaming unbzip2 implementatio in pure javascript for node and browsers

•    Javascript

---

streaming bzip2 decompressor in pure JS for Node and browserify. When browserified, the stream emits instances of feross/buffer instead of raw Uint8Arrays to have a consistant API across browsers and Node.

bzip bzip2 bz2 stream streaming decompress through

decompress-tarbz2 - tar.bz2 plugin for decompress

•    Javascript

---

Returns both a Promise for a Buffer and a Duplex stream. Buffer to decompress.

bz2 decompress decompressplugin extract tar tar.bz2 tarbz2