s3mper - s3mper - Consistent Listing for S3

  •        0

| Hash Key: path | Range Key: file | epoch | deleted | dir | linkPath | linkFile || -------------- | --------------- | -------- | ---------- | ------ | ----------- | ----------- || //\/\ | \| \ | \| \ | N/A | N/A || epoch[^2] | \| N/A | N/A | N/A | //\/\ | \ |The purpose of this table scheme is to provide range query operations for directory listings and for timeseries deletes. [^1]: The indexes are not implemented using DynamoDB Secondary Indexes due to constrains[^2]: This is a static value _'epoch'_ [Building](id:build)--------A gradle wrapper is used to build s3mper and can be run without additional tools. Edit the `build.gradle` to the appropriate version of hadoop and build with the following command. ```$ ./gradlew release```This will produce the necessary jar files for use with hadoop in `build/libs` and a tar file with all dependencies for use with the admin tool.Installing----------Installation requires the following steps: * Installing libraries on client and cluster hosts * Modifying the hadoop configuration to enable s3mper

https://github.com/Netflix/s3mper

Tags
Implementation
License
Platform

   

comments powered by Disqus


Related Projects