omniparser - omniparser: a native Golang ETL streaming parser and transform library for CSV, JSON, XML, EDI, text, etc

  •        769

Omniparser is a native Golang ETL parser that ingests input data of various formats (CSV, txt, fixed length/width, XML, EDI/X12/EDIFACT, JSON, and custom formats) in streaming fashion and transforms data into desired JSON output based on a schema written in JSON. In the example folders above you will find pairs of input files and their schema files. Then in the .snapshots sub directory, you'll find their corresponding output files.

https://github.com/jf-tech/omniparser

Tags
Implementation
License
Platform

   




Related Projects

EDIReader

  •    Java

EDIReader parses EDI input from ANSI X12 and EDIFACT, including documents for HIPAA compliance. It supports Java JAXP/SAX XML interfaces with a custom implementation of an quot;XMLquot; parser, allowing access to EDI data with XML tools.

edival EDI Parsing amp; Validation Library

  •    C

Edival is a simple EDI file parsing amp; validation library for the EDIFACT and X12 EDI standards. It is a stream-based parser in which an application defines event handlers for structures that the parser will find in a file, e.g. elements and segments.

EdiNet

  •    DotNet

Simple EDI reading\writing library + XmlReader over EDI data. Provides basic functionality sufficient to parse\read and write EDI streams. Currently X12 EDI only. Parser is general purpose, does not use maps\specifications, does not create XML hierarchy.

EDI4J

  •    Java

EDI4J is a java toolkit to read, write and translate EDI files (X12, UN/EDIFACT, HL7). EDI4J uses XML template files representing the structure and composition of an EDI file to parse EDI files into an XML translation.

JSV - A JavaScript implementation of an extendable, fully compliant JSON Schema validator.

  •    Javascript

A JSON validator is a program that takes JSON data and, with a provided schema, will ensure that the provided JSON is structured in the way defined by the schema. This ensures that if validation has passed, the JSON instance is guaranteed to be in the expected format. It will also provide an explanation on why a particular instance failed validation. There is no one way to validate JSON, just like there is no one way to validate XML. Even the JSON Schema specification has gone through several revisions which are not 100% backwards compatible with each other. To solve the issue of using numerous schemas already written to older specifications, JSV provides customizable environments to validate your JSON within.


OopFactory X12 Parser

  •    

This is an open source .NET C# implementation of an X12 Parser. The parser allows for a specification of any X12 transaction set to create a generic X12 xml representation of the hierarchical data contained within the X12 document. No database integration is required by de...

fluent-json-schema - A fluent API to generate JSON schemas

  •    Javascript

A fluent API to generate JSON schemas (draft-07) for Node.js and browser. Framework agnostic.

json-schema - Ruby JSON Schema Validator

  •    Ruby

This library is intended to provide Ruby with an interface for validating JSON objects against a JSON schema conforming to JSON Schema Draft 4. Legacy support for JSON Schema Draft 3, JSON Schema Draft 2, and JSON Schema Draft 1 is also included. Please be aware that the upgrade to version 2.0.0 will use Draft-04 by default, so schemas that do not declare a validator using the $schema keyword will use Draft-04 now instead of Draft-03. This is the reason for the major version upgrade.

json-schema - Ruby JSON Schema Validator

  •    Ruby

This library is intended to provide Ruby with an interface for validating JSON objects against a JSON schema conforming to JSON Schema Draft 4. Legacy support for JSON Schema Draft 3, JSON Schema Draft 2, and JSON Schema Draft 1 is also included. Please be aware that the upgrade to version 2.0.0 will use Draft-04 by default, so schemas that do not declare a validator using the $schema keyword will use Draft-04 now instead of Draft-03. This is the reason for the major version upgrade.

FlatPack - CSV/Tab Delimited and Fixed Length Parser and Writer

  •    Java

Simple Java delimited and fixed width file parser. Handles CSV, Excel CSV, Tab, Pipe delimiters, just to name a few. Maps column positions in the file to user friendly names via XML.

Apache Xerces for Java XML Parser

  •    Java

Xerces-J is a validating XML parser written in Java.

z-schema - JSON Schema validator written in JavaScript for NodeJS and Browsers

  •    Javascript

Validator will try to perform sync validation when possible for speed, but supports async callbacks when they are necessary. In case you have some remote references in your schemas, you have to download those schemas before using validator. Otherwise you'll get UNRESOLVABLE_REFERENCE error when trying to compile a schema.

NJsonSchema - JSON Schema reader, generator and validator for .NET

  •    CSharp

NJsonSchema is a .NET library to read, generate and validate JSON Schema draft v4+ schemas. The library can read a schema from a file or string and validate JSON data against it. A schema can also be generated from an existing .NET class. With the code generation APIs you can generate C# and TypeScript classes or interfaces from a schema. The library uses Json.NET to read and write JSON data.

NJsonSchema - JSON Schema reader, generator and validator for .NET

  •    CSharp

NJsonSchema is a .NET library to read, generate and validate JSON Schema draft v4+ schemas. The library can read a schema from a file or string and validate JSON data against it. A schema can also be generated from an existing .NET class. With the code generation APIs you can generate C# and TypeScript classes or interfaces from a schema. The library uses Json.NET to read and write JSON data and Namotion.Reflection for additional .NET reflection APIs.

json-schema - JSON Schema specifications, reference schemas, and a CommonJS implementation

  •    Javascript

JSON Schema specifications, reference schemas, and a CommonJS implementation

VisualJsonEditor - A JSON schema based file editor for Windows.

  •    CSharp

Visual JSON Editor is a JSON schema draft v4 based file editor for Windows: When opening a JSON file, the application auto-generates an editor GUI based on the provided JSON schema. The goal is to make JSON editing more effective and easier for users. Tip: Use the NJsonSchema library to generate JSON Schemas from your C# classes.

EdiFabric

  •    DotNet

ediFabric is a .NET library to convert EDI documents into typed .NET objects and vice verse. It can serialize\deserialize to\from XML.

JSON-Schema-Test-Suite - A language agnostic test suite for the JSON Schema specifications

  •    Python

This repository contains a set of JSON objects that implementors of JSON Schema validation libraries can use to test their validators. It is meant to be language agnostic and should require only a JSON parser.

csv-schema - Analyzes a CSV file and generates database table schema, all within the browser

  •    Javascript

This application parses CSV files (including huge ones) within the browser. It analyzes each field to suggest the best database field type, max length, and whether or not there are any null values. From there, you can rename fields, ignore them, override field types/lengths, etc. and generate database table creation sql for MySQL, MariaDB, Postres, Oracle, or SQLite3. This application uses PapaParse for CSV parsing and Knex.js for SQL query building.

Wire - Clean, lightweight protocol buffers for Android and Java.

  •    Java

Schemas describe and document data models. If you have data, you should have a schema. Google's Protocol Buffers are built around a great schema language. It's cross platform and language independent. Whatever programming language you use, you'll be able to use proto schemas with your application. Proto schemas are backwards-compatible and future-proof. You can evolve your schema as your application loses old features and gains new ones.






We have large collection of open source products. Follow the tags from Tag Cloud >>


Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.