PapaParse - Fast and powerful CSV (delimited text) parser that gracefully handles large files and malformed input

•    Javascript

---

Fast and powerful CSV parser for the browser that supports web workers and streaming large files. Converts CSV to JSON and JSON to CSV.

csv csv-parser parser parse parsing delimited text data auto-detect comma tab pipe file filereader stream worker workers thread threading multi-threaded jquery-plugin

FlatPack - CSV/Tab Delimited and Fixed Length Parser and Writer

•    Java

---

Simple Java delimited and fixed width file parser. Handles CSV, Excel CSV, Tab, Pipe delimiters, just to name a few. Maps column positions in the file to user friendly names via XML.

csv-parser csv parser

node-csv-parse - CSV parsing implementing the Node.js `stream.Transform` API

•    CoffeeScript

---

Part of the CSV module, this project is a parser converting CSV text input into arrays or objects. It implements the Node.js stream.Transform API. It also provides a simple callback-based API for convenience. It is both extremely easy to use and powerful. It was first released in 2010 and is used against big data sets by a large community. Documentation for the "csv-parse" package is available here.

csv parser nodejs streaming parse

threads.js - Easy to use, yet powerful multi-threading library for node.js and the browser.

•    Javascript

---

Javascript thread library. Uses web workers when run in browsers and child processes when run by node.js. Also supports browsers which do not support web workers.You don't have to write the thread's code inline. The file is expected to be a commonjs module (so something that uses module.exports = ...), for node and browser.

nodejs thread-pool web-worker isomorphic-javascript threads cluster child_process threadpool spawn fork parallel

pthreads - Threading for PHP

•    PHP

---

This project provides multi-threading that is compatible with PHP based on Posix Threads. It can execute any and all predefined and user declared methods and functions asynchronously. It has built-in support of Synchronization, Synchronized Methods.

thread threading multi-threading php-threading posix-thread worker-thread

vroom - Fast reading of delimited files

•    C++

---

The fastest delimited reader for R, 1.27 GB/sec. vroom doesn’t stop to actually read all of your data, it simply indexes where each record is located so it can be read later. The vectors returned use the Altrep framework to lazily load the data on-demand when it is accessed, so you only pay for what you use. This lazy access is done automatically, so no changes to your R data-manipulation code are needed.

r csv csv-parser tsv tsv-parser fixed-width-text

node-csvtojson - Blazing fast and Comprehensive CSV Parser for Node.JS / Browser / Command Line.

•    TypeScript

---

Here is a free online csv to json convert service utilizing latest csvtojson module. csvtojson has released version 2.0.0.

csv csvtojson csvparser nodejs csv-data csv-row csv-columns csv-stream parse csv-parser parse-csv json csv-to-json csv-convert tojson convert-csv-to-json csv-json

yew - Rust framework for building client web apps

•    Rust

---

Yew is a modern Rust framework inspired by Elm and ReactJS for creating multi-threaded frontend apps with WebAssembly. NEW! The framework supports multi-threading & concurrency out of the box. It uses Web Workers API to spawn actors (agents) in separate threads and uses a local scheduler attached to a thread for concurrent tasks.

web gui jsx elm web-framework wasm asmjs emscripten concurrency multithreading webworkers

ng-csv - Simple directive that turns arrays and objects into downloadable CSV files

•    Javascript

---

Add ng-csv.min.js to your main file (index.html). please also make sure you're adding angular-sanitize.min.js.ng-csv: The data array - Could be an expression, a value or a promise.

angular angularjs csv angular-component

Odyssey - Scalable PostgreSQL connection pooler

•    C

---

Advanced multi-threaded PostgreSQL connection pooler and request router. Odyssey can significantly scale processing performance by specifying a number of additional worker threads. Each worker thread is responsible for authentication and proxying client-to-server and server-to-client requests. All worker threads are sharing global server connection pools. Multi-threaded design plays important role in SSL/TLS performance.

connection-pool connections postgresql pooling

RecordEditor

•    Java

---

Editor for Fixed Width, Csv and Existing Xml files.

SQL CLR Export Functions

•    

---

SQL CLR Export, written in VB.NET which provides the ability to export data from SQL Server to 6 different text file formats: HTML, comma separated,tab separated, custom delimited, fixed width, and XML. This project provides a much needed example and powerful functionality ...

js-data-angular - Angular wrapper for js-data

•    Javascript

---

Angular wrapper for js-data.Angular-data is deprecated. js-data + js-data-angular is the new hotness.

angular angularjs angular-component

csv-schema - Analyzes a CSV file and generates database table schema, all within the browser

•    Javascript

---

This application parses CSV files (including huge ones) within the browser. It analyzes each field to suggest the best database field type, max length, and whether or not there are any null values. From there, you can rename fields, ignore them, override field types/lengths, etc. and generate database table creation sql for MySQL, MariaDB, Postres, Oracle, or SQLite3. This application uses PapaParse for CSV parsing and Knex.js for SQL query building.

structured-text-tools - A list of command line tools for manipulating structured text data

•    

---

The following is a list of text-based file formats and command line tools for manipulating each. Delimiter-separated values, including CSV, TSV, etc.

clis list csv tsv delimited-files text-files json yaml toml xml html ini structured-text conversion configuration-file

url-parse - Small footprint URL parser that works seamlessly across Node

•    Javascript

---

The url-parse method exposes two different API interfaces. The url interface that you know from Node.js and the new URL interface that is available in the latest browsers.In version 0.1 we moved from a DOM based parsing solution, using the <a> element, to a full Regular Expression solution. The main reason for this was to make the URL parser available in different JavaScript environments as you don't always have access to the DOM. An example of such environment is the Worker interface. The RegExp based solution didn't work well as it required a lot of lookups causing major problems in FireFox. In version 1.0.0 we ditched the RegExp based solution in favor of a pure string parsing solution which chops up the URL into smaller pieces. This module still has a really small footprint as it has been designed to be used on the client side.

url parser uri parse query string querystring stringify

FiberTaskingLib - A library for enabling task-based multi-threading

•    C++

---

This is a library for enabling task-based multi-threading. It allows execution of task graphs with arbitrary dependencies. Dependencies are represented as atomic counters. Under the covers, the task graph is executed using fibers, which in turn, are run on a pool of worker threads (one thread per CPU core). This allows the scheduler to wait on dependencies without task chaining or context switches.

cpp multithreading fibers task-scheduler coroutines

CleverCSV - CleverCSV is a Python package for handling messy CSV files

•    Python

---

CleverCSV provides a drop-in replacement for the Python csv package with improved dialect detection for messy CSV files. It also provides a handy command line tool that can standardize a messy file or generate Python code to import it. Click here to go to the introduction with more details about CleverCSV. If you're in a hurry, below is a quick overview of how to get started with the CleverCSV Python package and the command line interface.

csv-converter data-science data-mining csv csv-files python-library python3 datascience csv-format csv-reading csv-parser csv-reader csv-export csv-import csv-parsing

Opencsv - Easy-to-use CSV (comma-separated values) parser library for Java

•    Java

---

Opencsv is an easy-to-use CSV (comma-separated values) parser library for Java. Opencsv supports all the basic CSV-type things like Arbitrary numbers of values per line, Ignoring commas in quoted elements, Configurable separator and quote characters and lot more.

csv-parser csv parser library

automi - A stream API for Go (alpha)

•    Go

---

Automi abstracts away (not too far away) the gnarly details of using Go channels to create pipelined and staged processes. It exposes higher-level API to compose and integrate stream of data over Go channels for processing. This is still alpha work. The API is still evolving and changing rapidly with each commit (beware). Nevertheless, the core concepts are have been bolted onto the API. The following example shows how Automi could be used to compose a multi-stage pipeline to process stream of data from a csv file. The code implements stream processing based on the pipeline patterns. What is clearly absent, however, is the low level channel communication code to coordinate and synchronize goroutines. The programmer is provided a clean surface to express business code without the noisy channel infrastructure code. Underneath the cover however, Automi is using patterns similar to the pipeline patterns to create safe and concurrent structures to execute the processing of the data stream.

streaming-api stream-processing data-stream