miller - Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

•    C

---

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON. With Miller, you get to use named fields without needing to count positional indices, using familiar formats such as CSV, TSV, JSON, and positionally-indexed.

data-processing data-cleaning csv csv-files csv-format csv-reader streaming-data streaming-algorithms tsv json json-data data-reduction data-regression statistics statistical-analysis devops devops-tools tabular-data command-line command-line-tools

readr - Read flat files (csv, tsv, fwf) into R

•    R

---

The goal of readr is to provide a fast and friendly way to read rectangular data (like csv, tsv, and fwf). It is designed to flexibly parse many types of data found in the wild, while still cleanly failing when data unexpectedly changes. If you are new to readr, the best place to start is the data import chapter in R for data science. To accurately read a rectangular dataset with readr you combine two pieces: a function that parses the overall file, and a column specification. The column specification describes how each column should be converted from a character vector to the most appropriate data type, and in most cases it's not necessary because readr will guess it for you automatically.

r csv fwf parsing

csv - CSV Decoding and Encoding for Elixir

•    Elixir

---

RFC 4180 compliant CSV parsing and encoding for Elixir. Allows to specify other separators, so it could also be named: TSV. Why it is not idk, because of defaults I think. It parses files which contain rows (in utf-8) separated by either commas or other separators.

elixir csv encoding parsing stream parallelism rfc-4180

csvtk - A cross-platform, efficient and practical CSV/TSV toolkit in Golang

•    Go

---

Similar to FASTA/Q format in field of Bioinformatics, CSV/TSV formats are basic and ubiquitous file formats in both Bioinformatics and data sicence. People usually use spreadsheet softwares like MS Excel to do process table data. However it's all by clicking and typing, which is not automatically and time-consuming to repeat, especially when we want to apply similar operations with different datasets or purposes.

csv tsv cross-platform toolkit bioinformatics command-line tool

node-csv - Full featured CSV parser with simple api and tested against large datasets.

•    Javascript

---

This project provides CSV generation, parsing, transformation and serialization for Node.js. It has been tested and used by a large community over the years and should be considered reliable. It provides every option you would expect from an advanced CSV parser and stringifier.

csv parser nodejs streaming node tsv parse stringifier stringify

TextQL - Execute SQL against structured text like CSV or TSV

•    Go

---

TextQL allows you to easily execute SQL against structured text like CSV or TSV.

query-builder sql-builder sql-on-csv

q - q - Run SQL directly on CSV or TSV files

•    Python

---

q is a command line tool that allows direct execution of SQL-like queries on CSVs/TSVs (and any other tabular text files). q treats ordinary files as database tables, and supports all SQL constructs, such as WHERE, GROUP BY, JOINs etc. It supports automatic column name and column type detection, and provides full support for multiple encodings.

sql cli command-line-tool textasdata q qtextasdata csv tsv command-line

structured-text-tools - A list of command line tools for manipulating structured text data

•    

---

The following is a list of text-based file formats and command line tools for manipulating each. Delimiter-separated values, including CSV, TSV, etc.

clis list csv tsv delimited-files text-files json yaml toml xml html ini structured-text conversion configuration-file

php-export-data - PHP class to export data in CSV, TSV, or Excel XML (aka SpreadsheeML) format to a file or directly to the browser

•    PHP

---

A simple library for exporting tabular data to Excel-friendly XML, CSV, or TSV. It supports streaming exported data to a file or directly to the browser as a download so it is suitable for exporting large datasets (you won't run out of memory). See the test/ directory for more examples.

vroom - Fast reading of delimited files

•    C++

---

The fastest delimited reader for R, 1.27 GB/sec. vroom doesn’t stop to actually read all of your data, it simply indexes where each record is located so it can be read later. The vectors returned use the Altrep framework to lazily load the data on-demand when it is accessed, so you only pay for what you use. This lazy access is done automatically, so no changes to your R data-manipulation code are needed.

r csv csv-parser tsv tsv-parser fixed-width-text

datalib - JavaScript data utility library.

•    Javascript

---

Datalib is a JavaScript data utility library. It provides facilities for data loading, type inference, common statistics, and string templates. While datalib was created to power Vega and related projects, it is also a standalone library useful for data-driven JavaScript applications on both the client (web browser) and server (e.g., node.js). For documentation, see the datalib API Reference.

data table statistics parse csv tsv json utility

node-csvtojson - Blazing fast and Comprehensive CSV Parser for Node.JS / Browser / Command Line.

•    TypeScript

---

Here is a free online csv to json convert service utilizing latest csvtojson module. csvtojson has released version 2.0.0.

csv csvtojson csvparser nodejs csv-data csv-row csv-columns csv-stream parse csv-parser parse-csv json csv-to-json csv-convert tojson convert-csv-to-json csv-json

node-csv-parse - CSV parsing implementing the Node.js `stream.Transform` API

•    CoffeeScript

---

Part of the CSV module, this project is a parser converting CSV text input into arrays or objects. It implements the Node.js stream.Transform API. It also provides a simple callback-based API for convenience. It is both extremely easy to use and powerful. It was first released in 2010 and is used against big data sets by a large community. Documentation for the "csv-parse" package is available here.

csv parser nodejs streaming parse

Logger Library

•    

---

Logging library to ease all your logging needs. Can log to CSV/TSV files or database table. Contain both static and dynamic classes.

node-pg-copy-streams - COPY FROM / COPY TO for node-postgres

•    Javascript

---

COPY FROM / COPY TO for node-postgres. Stream from one database to another, and stuff. PostgreSQL supports streaming binary data directly into and out of a table. This means you can take your favorite CSV or TSV or whatever format file and pipe it directly into an existing PostgreSQL table.

postgres copy in out stream postgres-stream database-streaming

PapaParse - Fast and powerful CSV (delimited text) parser that gracefully handles large files and malformed input

•    Javascript

---

Fast and powerful CSV parser for the browser that supports web workers and streaming large files. Converts CSV to JSON and JSON to CSV.

csv csv-parser parser parse parsing delimited text data auto-detect comma tab pipe file filereader stream worker workers thread threading multi-threaded jquery-plugin

python-unicodecsv - Python2's stdlib csv module is nice, but it doesn't support unicode

•    Python

---

The unicodecsv is a drop-in replacement for Python 2.7's csv module which supports unicode strings without a hassle. Supported versions are python 2.6, 2.7, 3.3, 3.4, 3.5, and pypy 2.4.0. Python 2's csv module doesn't easily deal with unicode strings, leading to the dreaded "'ascii' codec can't encode characters in position ..." exception.

jquery-csv - A jQuery CSV parser plugin. Battle Tested | Optimized | 100% IETF RFC 4180 Complete

•    Javascript

---

Notice: This is a continuation of the jquery-csv project hosted on Google Code. JavaScript is growing up and HTML is finally maturing the point where webapps are being built to completely displace desktop applications. It's about time that the supporting libraries grow up too.

csv - CSV data manipulation made easy in PHP

•    PHP

---

Csv is a simple library to ease CSV parsing, writing and filtering in PHP. The goal of the library is to be powerful while remaining lightweight, by utilizing PHP native classes whenever possible.Full documentation can be found at csv.thephpleague.com.

csv-document csv-converter csv-filter csv-query csv

csvutil - csvutil provides fast and idiomatic mapping between CSV and Go (golang) values.

•    Go

---

Package csvutil provides fast and idiomatic mapping between CSV and Go values. This package does not provide a CSV parser itself, it is based on the Reader and Writer interfaces which are implemented by eg. std csv package. This gives a possibility of choosing any other CSV writer or reader which may be more performant.

csv fast csv-parser csvutil marshal gocsv decoder unmarshal streaming std-csv