PapaParse - Fast and powerful CSV (delimited text) parser that gracefully handles large files and malformed input

•    Javascript

---

Fast and powerful CSV parser for the browser that supports web workers and streaming large files. Converts CSV to JSON and JSON to CSV.

csv csv-parser parser parse parsing delimited text data auto-detect comma tab pipe file filereader stream worker workers thread threading multi-threaded jquery-plugin

stats - A statistics package with common functions that are missing from the Golang standard library

•    Go

---

A statistics package with many functions missing from the Golang standard library. See the CHANGELOG.md for API changes and tagged releases you can vendor into your projects.Protip: go get -u github.com/montanaflynn/stats updates stats to the latest version.

statistics math data analytics

Buckets-JS - A complete, fully tested and documented data structure library written in pure JavaScript

•    Javascript

---

Buckets is a complete, fully tested and documented data structure library written in pure JavaScript.

data-structures collections collection linked-list dictionary map multimap stack queue set bag binary-heap priority-queue binary-search binary-search-tree tree tree-structure buckets data structure linked list heap priority binary data-structure hashmap

mori - ClojureScript's persistent data structures and supporting API from the comfort of vanilla JavaScript

•    Clojure

---

Persistent Data Structures for JavaScript

data structure persistent clojurescript map filter reduce data-structure collections hashmap

awesome-awesome - A curated list of awesome curated lists of many topics.

•    

---

A curated list of awesome curated lists of many topics.

curated-lists science machine-learning database awesome awesome-list data data-processing editor web-browser jquery jquery-plugin

jsonplaceholder - A simple online fake REST API server

•    Javascript

---

JSONPlaceholder is a simple fake REST API for testing and prototyping.It's like an image placeholder but for web developers.

online fake api rest json server dummy data testing prototyping

Bogus - :card_index: A simple and sane fake data generator for C#, F#, and VB

•    CSharp

---

Hello. I'm your host Brian Chavez (twitter). Bogus is a simple and sane fake data generator for .NET languages like C#, F# and VB.NET. Bogus is fundamentally a C# port of faker.js and inspired by FluentValidation's syntax sugar.Minimum Requirements: .NET Standard 1.3 or .NET Framework 4.0.

fake data generator faker c-sharp bogus poco data-access-layer database seed test-data data-generator

onyx - Distributed, masterless, high performance, fault tolerant data processing

•    Clojure

---

Changelog can be found at changes.md.A searchable set of documentation for the Onyx data model is available.

distributed streaming batch data

ISO-3166-Countries-with-Regional-Codes - ISO 3166-1 country lists merged with their UN Geoscheme regional codes in ready-to-use JSON, XML, CSV data sets

•    Ruby

---

These lists are the result of merging data from two sources, the Wikipedia ISO 3166-1 article for alpha and numeric country codes, and the UN Statistics site for countries' regional, and sub-regional codes. In addition to countries, it includes dependent territories. The International Organization for Standardization (ISO) site provides partial data (capitalised and sometimes stripped of non-latin ornamentation), but sells the complete data set as a Microsoft Access 2003 database. Other sites give you the numeric and character codes, but there appeared to be no sites that included the associated UN-maintained regional codes in their data sets. I scraped data from the above two websites that is all publicly available already to produce some ready-to-use complete data sets that will hopefully save someone some time who had similar needs.

region-codes countries iso csv json xml dataset data

recline - A simple but powerful library for building data applications in pure Javascript and HTML.

•    Javascript

---

A simple but powerful library for building data applications in pure Javascript and HTML. See CONTRIBUTING.md.

app data explorer grid library table

knowledge-repo - A next-generation curated knowledge sharing platform for data scientists and other technical professions

•    Python

---

The Knowledge Repository project is focused on facilitating the sharing of knowledge between data scientists and other technical roles using data formats and tools that make sense in these professions. It provides various data stores (and utilities to manage them) for "knowledge posts", with a particular focus on notebooks (R Markdown and Jupyter / IPython Notebook) to better promote reproducible research.Check out this Medium Post for the inspiration for the project.

data data-science knowledge data-analysis

streamalert - StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define

•    Python

---

StreamAlert is a serverless, realtime data analysis framework which empowers you to ingest, analyze, and alert on data from any environment, using datasources and alerting logic you define.

security kinesis serverless terraform lambda aws rules analysis data

nano - Nano is now part of Apache CouchDB. Repo moved to https://GitHub.com/apache/couchdb-nano

•    Javascript

---

you can also see your document in futon.

couchdb callback data request json nosql micro nano database

simple-peer - 📡 Simple WebRTC video/voice and data channels

•    Javascript

---

This module works in the browser with browserify.Note: If you're NOT using browserify, then use the included standalone file simplepeer.min.js. This exports a SimplePeer constructor on window.

webrtc p2p nodejs browser data-channels peer-connection data data-channel data-channel-stream peer peer-to-peer stream video voice webrtc-stream

incubator-superset - Apache Superset (incubating) is a modern, enterprise-ready business intelligence web application

•    Python

---

Apache Superset (incubating) is a modern, enterprise-ready business intelligence web application

druid data-visualization dashboards data data-analysis sql-editor

SparkleShare - Self hosted, Secure, Instant file sync, Dropbox alternative

•    CSharp

---

SparkleShare is a file sharing and collaboration app. It works just like Dropbox, and you can run it on your own server. It creates a special folder on your computer. You can add remotely hosted folders (or "projects") to this folder. These projects will be automatically kept in sync with both the host and all of your peers when someone adds, removes or edits a file.

cloud-file-sharing cloud file-sharing data sharing collaboration dropbox-alternative

awesome-json-datasets - A curated list of awesome JSON datasets that don't require authentication.

•    Javascript

---

A curated list of awesome JSON datasets that don't require authentication. Pro Tip: Check out Blockchain Data API for more options.

json-dataset json awesome awesome-list list data dataset datasets

sql.js - SQLite compiled to JavaScript through Emscripten

•    Javascript

---

sql.js is a port of SQLite to JavaScript, by compiling the SQLite C code with Emscripten. It uses a virtual database file stored in memory, and thus doesn't persist the changes made to the database. However, it allows you to import any existing sqlite file, and to export the created database as a javascript typed array. There is no C bindings or node-gyp compilation here, sql.js is a simple javascript file, that can be used like any traditional javascript library. If you are building a native application in javascript (using Electron for instance), or are working in node.js, you will likely prefer to use a native binding of SQLite to javascript.

sql sqlite stand-alone relational database rdbms data query statement emscripten asm asm.js

react-refetch - A simple, declarative, and composable way to fetch data for React components

•    Javascript

---

A simple, declarative, and composable way to fetch data for React components. Requires React 0.14 or later.

react rest api data fetch reactjs ajax hot reload hmr live edit

kiba - Data processing & ETL framework for Ruby

•    Ruby

---

If you need help, please ask your question with tag kiba-etl on StackOverflow so that other can benefit from your contribution! I monitor this specific tag and will reply to you. Writing reliable, concise, well-tested & maintainable data-processing code is tricky.

etl etl-ruby data rubydatascience