datalib - JavaScript data utility library.

  •        41

Datalib is a JavaScript data utility library. It provides facilities for data loading, type inference, common statistics, and string templates. While datalib was created to power Vega and related projects, it is also a standalone library useful for data-driven JavaScript applications on both the client (web browser) and server (e.g., node.js). For documentation, see the datalib API Reference.

http://vega.github.io/datalib/
https://github.com/vega/datalib

Dependencies:

d3-dsv : 0.1
d3-format : 0.4
d3-time : 0.1
d3-time-format : 0.2
request : ^2.67.0
sync-request : ^2.1.0
topojson-client : ^3.0.0

Tags
Implementation
License
Platform

   




Related Projects

CSV.js - A simple, blazing-fast CSV parser and encoder. Full RFC 4180 compliance.

  •    Javascript

Simple, blazing-fast CSV parsing/encoding in JavaScript. Full RFC 4180 compliance. Compatible with browsers (>IE8), AMD, and NodeJS.

csvtk - A cross-platform, efficient and practical CSV/TSV toolkit in Golang

  •    Go

Similar to FASTA/Q format in field of Bioinformatics, CSV/TSV formats are basic and ubiquitous file formats in both Bioinformatics and data sicence. People usually use spreadsheet softwares like MS Excel to do process table data. However it's all by clicking and typing, which is not automatically and time-consuming to repeat, especially when we want to apply similar operations with different datasets or purposes.

readr - Read flat files (csv, tsv, fwf) into R

  •    R

The goal of readr is to provide a fast and friendly way to read rectangular data (like csv, tsv, and fwf). It is designed to flexibly parse many types of data found in the wild, while still cleanly failing when data unexpectedly changes. If you are new to readr, the best place to start is the data import chapter in R for data science. To accurately read a rectangular dataset with readr you combine two pieces: a function that parses the overall file, and a column specification. The column specification describes how each column should be converted from a character vector to the most appropriate data type, and in most cases it's not necessary because readr will guess it for you automatically.


Vega Lite - A concise grammar of interactive graphics, built on Vega

  •    TypeScript

Vega-Lite is a high-level grammar of interactive graphics. It provides a concise JSON syntax for rapidly generating visualizations to support analysis. Vega-Lite specifications can be compiled to Vega specifications.

ISO-3166-Countries-with-Regional-Codes - ISO 3166-1 country lists merged with their UN Geoscheme regional codes in ready-to-use JSON, XML, CSV data sets

  •    Ruby

These lists are the result of merging data from two sources, the Wikipedia ISO 3166-1 article for alpha and numeric country codes, and the UN Statistics site for countries' regional, and sub-regional codes. In addition to countries, it includes dependent territories. The International Organization for Standardization (ISO) site provides partial data (capitalised and sometimes stripped of non-latin ornamentation), but sells the complete data set as a Microsoft Access 2003 database. Other sites give you the numeric and character codes, but there appeared to be no sites that included the associated UN-maintained regional codes in their data sets. I scraped data from the above two websites that is all publicly available already to produce some ready-to-use complete data sets that will hopefully save someone some time who had similar needs.

vega - A visualization grammar.

  •    Javascript

Vega is a visualization grammar, a declarative format for creating, saving, and sharing interactive visualization designs. With Vega you can describe data visualizations in a JSON format, and generate interactive views using either HTML5 Canvas or SVG. For documentation, tutorials, and examples, see the Vega website. For a description of changes between Vega 2 and later versions, please refer to the Vega Porting Guide.

pivot.js - Build Pivot Tables from CSV/JSON Data

  •    Javascript

Pivot.js is a simple way for you to get to your data. It allows for the creation of highly customizable unique table views from your browser. In data processing, a pivot table is a data summarization tool found in data visualization programs such as spreadsheets or business intelligence software. Among other functions, pivot-table tools can automatically sort, count, total or give the average of the data stored in one table or spreadsheet. It displays the results in a second table (called a "pivot table") showing the summarized data.

echo - Echo converts HTML tables into JSON/CSV objects. Use it to make html data easy to transport.

  •    Javascript

Echo is able to read tables from a website or a html file and convert it to JSON or CSV. Perfect for saving data from a website and loading it into excel, database, etc. For our examples we will be using the tables from www.coolgithubprojects.com. We use .convert for local HTML files and .convertUrl for online retrieval.

php-export-data - PHP class to export data in CSV, TSV, or Excel XML (aka SpreadsheeML) format to a file or directly to the browser

  •    PHP

A simple library for exporting tabular data to Excel-friendly XML, CSV, or TSV. It supports streaming exported data to a file or directly to the browser as a download so it is suitable for exporting large datasets (you won't run out of memory). See the test/ directory for more examples.

vroom - Fast reading of delimited files

  •    C++

The fastest delimited reader for R, 1.27 GB/sec. vroom doesn’t stop to actually read all of your data, it simply indexes where each record is located so it can be read later. The vectors returned use the Altrep framework to lazily load the data on-demand when it is accessed, so you only pay for what you use. This lazy access is done automatically, so no changes to your R data-manipulation code are needed.

node-csv - Full featured CSV parser with simple api and tested against large datasets.

  •    Javascript

This project provides CSV generation, parsing, transformation and serialization for Node.js. It has been tested and used by a large community over the years and should be considered reliable. It provides every option you would expect from an advanced CSV parser and stringifier.

stickshift - A clean & modern SQL data interface.

  •    Javascript

A clean & modern data interface: SQL queries into JSON, CSV, and charts, done simply. This project is meant to be run as a server. See Stickshift.app for a version that works as a desktop application.

csvtotable - Simple command-line utility to convert CSV files to searchable and sortable HTML table.

  •    Python

Simple command-line utility to convert CSV files to searchable and sortable HTML table. Supports large datasets and horizontal scrolling for large number of columns. Here is a demo of sample csv file converted to HTML table.

mcc-mnc-table - Mobile Country Codes (MCC) and Mobile Network Codes (MNC) table in CSV, JSON and XML

  •    Python

Mobile Country Codes (MCC) and Mobile Network Codes (MNC) table in CSV, JSON and XML. Updated monthly. The table is pulled from http://mcc-mnc.com/.

csv-parser - Streaming csv parser inspired by binary-csv that aims to be faster than everyone else

  •    Javascript

csv-parser can convert CSV into JSON at at rate of around 90,000 rows per second (perf varies with data, try bench.js with your data).The data emitted is a normalized JSON object. Each header is used as the property name of the object.