FlatFiles - Reads and writes CSV, fixed-length and other flat file formats with a focus on schema definition, configuration and speed

  •        20

Reads and writes CSV, fixed-length and other flat file formats with a focus on schema definition, configuration and speed. Supports mapping directly between files and classes.As a bonus for those of you using FlatFiles, as of version 1.2, you should now be seeing a nearly 2x performance improvement over previous versions, both read and write, both CSV and fixed-length. I spent some time playing with BenchmarkDotNet and using the profiler to squeeze every ounce of performance out of FlatFiles.

https://github.com/jehugaleahsa/FlatFiles

Tags
Implementation
License
Platform

   




Related Projects

RecordEditor

  •    Java

Editor for Fixed Width, Csv and Existing Xml files.

vroom - Fast reading of delimited files

  •    C++

The fastest delimited reader for R, 1.27 GB/sec. vroom doesn’t stop to actually read all of your data, it simply indexes where each record is located so it can be read later. The vectors returned use the Altrep framework to lazily load the data on-demand when it is accessed, so you only pay for what you use. This lazy access is done automatically, so no changes to your R data-manipulation code are needed.

readr - Read flat files (csv, tsv, fwf) into R

  •    R

The goal of readr is to provide a fast and friendly way to read rectangular data (like csv, tsv, and fwf). It is designed to flexibly parse many types of data found in the wild, while still cleanly failing when data unexpectedly changes. If you are new to readr, the best place to start is the data import chapter in R for data science. To accurately read a rectangular dataset with readr you combine two pieces: a function that parses the overall file, and a column specification. The column specification describes how each column should be converted from a character vector to the most appropriate data type, and in most cases it's not necessary because readr will guess it for you automatically.

Flat File Reporting

  •    

This project offers Drag and Drop Report Design (via IReports / Jasper Reports) for Flat Files (Fixed Width / CSV / Cobol)


q - q - Run SQL directly on CSV or TSV files

  •    Python

q is a command line tool that allows direct execution of SQL-like queries on CSVs/TSVs (and any other tabular text files). q treats ordinary files as database tables, and supports all SQL constructs, such as WHERE, GROUP BY, JOINs etc. It supports automatic column name and column type detection, and provides full support for multiple encodings.

JFlat

  •    Java

JFlat is a Java API for writing to and from flat files such as CSV and fixed width. It can map to and from Java beans, provides callbacks to implement custom handling, and is highly customizable.

CSV.js - A simple, blazing-fast CSV parser and encoder. Full RFC 4180 compliance.

  •    Javascript

Simple, blazing-fast CSV parsing/encoding in JavaScript. Full RFC 4180 compliance. Compatible with browsers (>IE8), AMD, and NodeJS.

FlatPack - CSV/Tab Delimited and Fixed Length Parser and Writer

  •    Java

Simple Java delimited and fixed width file parser. Handles CSV, Excel CSV, Tab, Pipe delimiters, just to name a few. Maps column positions in the file to user friendly names via XML.

csv - CSV Decoding and Encoding for Elixir

  •    Elixir

RFC 4180 compliant CSV parsing and encoding for Elixir. Allows to specify other separators, so it could also be named: TSV. Why it is not idk, because of defaults I think. It parses files which contain rows (in utf-8) separated by either commas or other separators.

csv-schema - Analyzes a CSV file and generates database table schema, all within the browser

  •    Javascript

This application parses CSV files (including huge ones) within the browser. It analyzes each field to suggest the best database field type, max length, and whether or not there are any null values. From there, you can rename fields, ignore them, override field types/lengths, etc. and generate database table creation sql for MySQL, MariaDB, Postres, Oracle, or SQLite3. This application uses PapaParse for CSV parsing and Knex.js for SQL query building.

SoftwareBotany.Ivy String Utils w/ Quoted Delimited (CSV) & Fixed-Width Parsers

  •    

The Software Botany Ivy project is a library containing various string utilities. Included in the library are fluent APIs for parsing and creating quoted delimited and fixed-width positional text. For example, quoted CSV such as that used by Microsoft Excel is supported. The ...

DataFile

  •    Java

Java utility library for reading text based data files such as CSV, tab separated, and fixed width format files.

SimpleFlatMapper - Fast and Easy mapping from database and CSV to POJO

  •    Java

Fast and Easy mapping from database and CSV to POJO. It is a java micro ORM, lightweight alternative to iBatis and Hibernate. It supports Fast Csv Parser and Csv Mapper.

CSV Parser

  •    DotNet

A small handy little tool for reading, editing and saving csv files.

AdaptiveTableLayout - Library that makes it possible to read, edit and write CSV files

  •    Java

Pay your attention to our new library that makes it possible to read, edit and write CSV files. If you use Android-based device, you can easily use our library for implementation of all aforementioned actions. In addition, you will be able to change rows and columns, display the picture via link, and align the required data. It will surely help you cope with your tasks faster and make your output higher. AdaptiveTableLayout library is at your disposal. The main goal of the library is to apply all its functions in the process of working with CSV files. Moreover, it will give you a competitive edge over others.

csvtk - A cross-platform, efficient and practical CSV/TSV toolkit in Golang

  •    Go

Similar to FASTA/Q format in field of Bioinformatics, CSV/TSV formats are basic and ubiquitous file formats in both Bioinformatics and data sicence. People usually use spreadsheet softwares like MS Excel to do process table data. However it's all by clicking and typing, which is not automatically and time-consuming to repeat, especially when we want to apply similar operations with different datasets or purposes.

FcaBedrock Formal Context Creator

  •    

FcaBedrock is a tool for creating context files for Formal Concept Analysis. It can convert existing data sets in flat-file CSV or 3-column CSV, to Burmeister (.cxt) or FIMI (.dat) context files.

FlatTree

  •    Java

Java library for reading and writing of flat files. CSV, FLR (fixed length record) or mixed structures. Tree-style processing API. Adapters for SAX, Stax and XStream for transformation, data binding or serialization.





We have large collection of open source products. Follow the tags from Tag Cloud >>


Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.