tarsplitter - A multithreaded tar utility

  •        83

Work with huge numbers of small files more quickly. Create a tar archive using -p concurrent threads.

https://github.com/AQUAOSOTech/tarsplitter

Tags
Implementation
License
Platform

   




Related Projects

makeself - A self-extracting archiving tool for Unix systems, in 100% shell script.

  •    Shell

makeself.sh is a small shell script that generates a self-extractable compressed tar archive from a directory. The resulting file appears as a shell script (many of those have a .run suffix), and can be launched as is. The archive will then uncompress itself to a temporary directory and an optional arbitrary command will be executed (for example an installation script). This is pretty similar to archives generated with WinZip Self-Extractor in the Windows world. Makeself archives also include checksums for integrity self-validation (CRC and/or MD5/SHA256 checksums). The makeself.sh script itself is used only to create the archives from a directory of files. The resultant archive is actually a compressed (using gzip, bzip2, or compress) TAR archive, with a small shell script stub at the beginning. This small stub performs all the steps of extracting the files, running the embedded command, and removing the temporary files when done. All the user has to do to install the software contained in such an archive is to "run" the archive, i.e sh nice-software.run. I recommend using the ".run" (which was introduced by some Makeself archives released by Loki Software) or ".sh" suffix for such archives not to confuse the users, so that they will know they are actually shell scripts (with quite a lot of binary data attached to them though!).

Libarchive - C library and command-line tools for reading and writing tar, cpio, zip, ISO, and other

  •    C

The libarchive project develops a portable, efficient C library that can read and write streaming archives in a variety of formats. It also includes implementations of the common tar, cpio, and zcat command-line tools that use the libarchive library.

node-archiver - a streaming interface for archive generation

  •    Javascript

Visit the API documentation for a list of all methods available.Archiver ships with out of the box support for TAR and ZIP archives.

7-Zip-JBinding

  •    Java

Native (JNI) cross-platform library to extract (password protected, multi-part) 7z Zip Rar Tar Split Lzma Iso HFS GZip Cpio BZip2 Z Arj Chm Lhz Cab Nsis Deb Rpm Wim Udf archives from Java. Archive creation and more formats coming soon.

PeaZip - Cross-platform file and archive manager

  •    Pascal

PeaZip is a free file archiver utility and rar extractor for Windows and Linux, work with 150+ archive types and variants (7z, ace, arc, bz2, cab, gz, iso, paq, pea, rar, tar, wim, zip, zipx...), handle spanned archives and support multiple archive encryption standards. The project aims to provide a cross-platform, portable, GUI frontend for multiple Open Source technologies (7-Zip, FreeArc, PAQ, PEA, UPX) focused on file and archive management, and security


node-archiver - Creates Archives (Zip, Tar) via Node Streams.

  •    Javascript

Creates Archives (Zip, Tar) via Node Streams.

PhpZip Application

  •    PHP

PhpZip is a PHP application which manage compressed archives. PhpZip can archive and extract files and file systems (files + folders). PhpZip support several archive formats (proprietary, GNU TAR, Compressed, ...).

asar - Simple extensive tar-like archive format with indexing

  •    CoffeeScript

Simple extensive tar-like archive format with indexing

data_miner - Download, unpack from a ZIP/TAR/GZ/BZ2 archive, parse, correct, convert units and import Google Spreadsheets, XLS, ODS, XML, CSV, HTML, etc

  •    Ruby

Download, pull out of a ZIP/TAR/GZ/BZ2 archive, parse, correct, and import XLS, ODS, XML, CSV, HTML, etc. into your ActiveRecord models. Tested in MRI 1.8.7+, MRI 1.9.2+, and JRuby 1.6.7+. Thread safe.

asar - Simple extensive tar-like archive format with indexing

  •    Javascript

Asar is a simple extensive archive format, it works like tar that concatenates all files together without compression, while having random access support. You can pass in a transform option, that is a function, which either returns nothing, or a stream.Transform. The latter will be used on files that will be in the .asar file to transform them (e.g. compress).

ugrep - Ultra fast grep with interactive query UI and fuzzy search

  •    C++

ugrep is ultra fast grep with interactive query UI and fuzzy search. It can search file systems, source code, text, binary files, archives (cpio/tar/pax/zip), compressed files (gz/Z/bz2/lzma/xz/lz4/zstd), documents and more. A faster, user-friendly and compatible grep replacement.

casync - Content-Addressable Data Synchronization Tool

  •    C

Encoding: Let's take a large linear data stream, split it into variable-sized chunks (the size of each being a function of the chunk's contents), and store these chunks in individual, compressed files in some directory, each file named after a strong hash value of its contents, so that the hash value may be used to as key for retrieving the full chunk data. Let's call this directory a "chunk store". At the same time, generate a "chunk index" file that lists these chunk hash values plus their respective chunk sizes in a simple linear array. The chunking algorithm is supposed to create variable, but similarly sized chunks from the data stream, and do so in a way that the same data results in the same chunks even if placed at varying offsets. For more information see this blog story. Decoding: Let's take the chunk index file, and reassemble the large linear data stream by concatenating the uncompressed chunks retrieved from the chunk store, keyed by the listed chunk hash values.

Tardy

  •    C++

The tardy program is a tar(1) post-processor. It may be used to manipulate the file headers in tar(5) archive files in various ways. This can be useful when you want to remove development environment artifacts from tarballs you post on the Internet.

FSArchiver - Filesystem Archiver for Linux

  •    C

FSArchiver is a system tool that allows you to save the contents of a file-system to a compressed archive file. The file-system can be restored on a partition which has a different size and it can be restored on a different file-system. Unlike tar/dar, FSArchiver also creates the file-system when it extracts the data to partitions. Everything is checksummed in the archive in order to protect the data. If the archive is corrupt, you just loose the current file, not the whole archive.

TurboPower Abbrevia

  •    Pascal

Abbrevia is a compression toolkit for Delphi, C++Builder, Kylix, and Free Pascal. It supports compressing and decompressing PKZIP, Microsoft CAB, tar, gzip, and bzip2 archives, and can create self-extracting executables. On Windows it also provides Delphi wrappers for the LZMA, Bzip2, and WavPack SDKs, and PPMd decompression. Abbrevia also has several visual controls that simplify displaying and manipulating archives, including treeview and listview components.

duplicity - Encrypted bandwidth-efficient backup using the rsync algorithm

  •    Python

Duplicity backs directories by producing encrypted tar-format volumes and uploading them to a remote or local file server. Because duplicity uses librsync, the incremental archives are space efficient and only record the parts of files that have changed since the last backup. Because duplicity uses GnuPG to encrypt and/or sign these archives, they will be safe from spying and/or modification by the server.

JarWizy - A Java Archive Utility

  •    Java

An easy-to-use, user-friendly GUI for archived file formats (jar, zip, tar). Explorer-type archive browsing with all the archiving functionality offered through a much easier, quicker amp; more understandable manner than its command-line counterpart. This project has been replaced by Archive Buddy [http://sourceforge.net/projects/archivebuddy]

node-tar - tar for node

  •    Javascript

tar for node

archiver - Easily create and extract

  •    Go

Package archiver makes it trivially easy to make and extract common archive formats such as .zip, and .tar.gz. Simply name the input and output file(s).Files are put into the root of the archive; directories are recursively added, preserving structure.

AutoArchive

  •    Python

Utility to help create backups more easily. The idea of the program is that all essential information for creating a backup is in a single file. It can use ‘tar’ for creating archives, has a command line interface, and supports incremental backups.