With Quilt you can build, push, and install data packages. Data packages are versioned, reusable data structures that can be loaded into Python. Quilt is designed to support reproducible, auditable, and compliant workflows. Quilt consists of three source-level components data catalog, data registry and data compiler.
<BR><BR>
Its features include: 
<ul>
<li>Versioning and storage of large data</li>
<li>Transformation of a variety of file formats into data frames (via pandas and pyarrow)</li>
<li>De-duplication of repeated data for reduced disk and network footprint</li>
</ul>

With Quilt you can build, push, and install data packages. Data packages are versioned, reusable data structures that can be loaded into Python. Quilt is designed to support reproducible, auditable, and compliant workflows. Quilt consists of three source-level components data catalog, data registry and data compiler.

Quilt - Data Engineering Infrastructure

Discover open source projects across all platforms

Projects

Quilt - Data Engineering Infrastructure

TechStack

Tagcloud

License

Suggested keywords:

Projects

Quilt - Data Engineering Infrastructure

TechStack

Tagcloud

License