structured-text-tools - A list of command line tools for manipulating structured text data

•    

---

The following is a list of text-based file formats and command line tools for manipulating each. Delimiter-separated values, including CSV, TSV, etc.

clis list csv tsv delimited-files text-files json yaml toml xml html ini structured-text conversion configuration-file

tsv-utils - eBay's TSV Utilities: Command line tools for large, tabular data files

•    D

---

This is a set of command line utilities for manipulating large tabular data files. Files of numeric and text data commonly found in machine learning, data mining, and similar environments. Filtering, sampling, statistical calculations and other operations are supported. The tools were originally developed in Perl and used for day-to-day work in a large scale data mining environment. One of the tools was re-written in D as an exercise exploring the language. Significant performance gains and agreeable programmer characteristics soon led to writing additional utilities in D. Information on the D programming language is available at dlang.org.

csv command-line dlang data-science tabular-data cli delimited-files sampling data-wrangling tsv statistics reservoir-sampling

sqawk - Like Awk, but with SQL and table joins

•    Perl

---

Sqawk is an Awk-like program that uses SQL and can combine data from multiple files. It is powered by SQLite. where the script is your SQL.

sql data-wrangling cli csv tsv delimited-files data-transformation converter json