Displaying 1 to 20 from 26 results

Gluster Filesystem - Scalable Network Filesystem

  •    C

Gluster is a software defined distributed storage that can scale to several petabytes. It provides interfaces for object, block and file storage. It is a distributed scale-out filesystem that allows rapid provisioning of additional storage based on your storage consumption needs. It incorporates automatic failover as a primary feature.

BrowserFS - BrowserFS is an in-browser filesystem that emulates the Node JS filesystem API and supports storing and retrieving files from various backends

  •    Javascript

BrowserFS is an in-browser file system that emulates the Node JS file system API and supports storing and retrieving files from various backends. BrowserFS also integrates nicely into the Emscripten file system. More backends can be defined by separate libraries, so long as they extend the BaseFileSystem class. Multiple backends can be active at once at different locations in the directory hierarchy.

zbox - Zero-details, privacy-focused embeddable file system.

  •    Rust

Zbox is a zero-details, privacy-focused embeddable file system. Its goal is to help application store files securely, privately and reliably. By encapsulating files and directories into an encrypted repository, it provides a virtual file system and exclusive access to authorised application. Unlike other system-level file systems, such as ext4, XFS and Btrfs, which provide shared access to multiple processes, Zbox is a file system that runs in the same memory space as the application. It only provides access to one process at a time.

mc - Minio Client is a replacement for ls, cp, mkdir, diff and rsync commands for filesystems and object storage

  •    Go

Minio Client (mc) provides a modern alternative to UNIX commands like ls, cat, cp, mirror, diff, find etc. It supports filesystems and Amazon S3 compatible cloud storage service (AWS Signature v2 and v4).then use the mc config command.




Xtreemfs - Fault-tolerant distributed file system

  •    C

XtreemFS is a distributed, replicated and fault-tolerant file system for federated IT infrastructures. XtreemFS replicates your file data across multiple storage servers, which can be distributed worldwide. It scales according to your needs within minutes, simply by adding new standard hardware. Starting with a single server, growing to a cluster and across datacenters.

OrangeFS - Scale-out Network File System

  •    C

OrangeFS is a scale-out network file system designed for use on high-end computing (HEC) systems that provides very high-performance access to multi-server-based disk storage, in parallel. The OrangeFS server and client are user-level code, making them very easy to install and manage. OrangeFS has optimized MPI-IO support for parallel and distributed applications, and it is leveraged in production installations and used as a research platform for distributed and parallel storage.


BeeGFS - Parallel Cluster File System

  •    C

BeeGFS (formerly FhGFS) is the leading parallel cluster file system, developed with a strong focus on performance and designed for very easy installation and management. It transparently spreads user data across multiple servers. By increasing the number of servers and disks in the system, you can simply scale performance and capacity of the file system to the level that you need, seamlessly from small clusters up to enterprise-class systems with thousands of nodes.

diskover - File system crawler, disk space usage, file search engine and file system analytics powered by Elasticsearch

  •    Python

diskover is an open source file system crawler and disk space usage software that uses Elasticsearch to index and manage data across heterogeneous storage systems. Using diskover, you are able to more effectively search and organize files and system administrators are able to manage storage infrastructure, efficiently provision storage, monitor and report on storage use, and effectively make decisions about new infrastructure purchases. As the amount of file data generated by business' continues to expand, the stress on expensive storage infrastructure, users and system administrators, and IT budgets continues to grow.

glusterfs-java-filesystem - GlusterFS for Java

  •    Java

glusterfs-java-filesystem aims to be a complete implementation of a Java7/NIO.2 File System Provider backed by GlusterFS via libgfapi-jni

datastore-js - A fork of dropbox/dropbox-js which adds support for the Datastore API

  •    CoffeeScript

This fork of dropbox/dropbox-js adds support for the (deprecated) Datastore API in a branch called datastore. The purpose of publishing this code is to share a reference implementation of the merging strategy used by the Datastore API. For details, read "Deprecating the Sync and Datsatore APIs" on the Dropbox developer blog.This is a JavaScript client library for the Dropbox API, written in CoffeeScript, suitable for use in both modern browsers and in server-side code running under node.js.

laravel-storage - A simple filesystem abstraction package for Laravel 4.

  •    PHP

Storage is a filesystem abstraction layer for Laravel 4 applications. If you are using Laravel 5 it comes with a similar package included which can be found in the docs. After that, run composer install to install Storage.

node-giga - 📦 Easy streaming upload and download for File System, AWS S3

  •    Javascript

Giga is an abstract storage class to easily streaming upload and download files to Local File System, AWS S3, and more. This project follows the Contributor Covenant Code of Conduct.

cruise - User space POSIX-like file system in main memory

  •    C

With the massive scale of high-performance computing systems, long-running scientific parallel applications periodically save the state of their execution to files called checkpoints to recover from system failures. Checkpoints are stored on external parallel file systems, but limited bandwidth makes this a time-consuming operation. Multilevel checkpointing systems, like the Scalable Checkpoint/Restart (SCR) library, alleviate this bottleneck by caching checkpoints in storage located close to the compute nodes. However, most large scale systems do not provide file storage on compute nodes, preventing the use of SCR. CRUISE is a novel user-space file system that stores data in main memory and transparently spills over to other storage, like local flash memory or the parallel file system, as needed. This technique extends the reach of libraries like SCR to systems where they otherwise could not be used. CRUISE also exposes file contents for Remote Direct Memory Access, allowing external tools to copy checkpoints to the parallel file system in the background with reduced CPU interruption.

tus-ruby-server - Ruby server for tus resumable upload protocol

  •    Ruby

By default uploaded files will be stored in the data/ directory. After the upload is complete, you'll probably want to attach the uploaded file to a database record. Shrine is currently the only file attachment library that integrates well with tus-ruby-server, see this walkthrough that adds resumable uploads from scratch, and for a complete example you can check out the demo app. Running the tus server alongside your main app using classic web servers like Puma or Unicorn is probably fine for most cases, however, it does come with a few gotchas. First, since these web servers don't accept partial requests (request where the request body hasn't been fully received), the tus client must be configured to split the upload into multiple requests. Second, since web workers are tied for the duration of the request, serving uploaded files through the tus server app could significantly impact request throughput, so you need to be careful to avoid that.

cacache - 💩💵 but for your data. If you've got the hash, we've got the cache ™

  •    Javascript

cacache is a Node.js library for managing local key and content address caches. It's really fast, really good at concurrency, and it will never give you corrupted data, even if cache files get corrupted or manipulated. It was originally written to be used as npm's local cache, but can just as easily be used on its own.

cadr - content-addressable filesystem snapshots

  •    Javascript

cadr is a Node.js library for caching snapshots of filesystem trees. It supports full data verification on input and output, and is pretty fast at handling a bunch of files at a time. The cadr team enthusiastically welcomes contributions and project participation! There's a bunch of things you can do if you want to contribute! The Contributor Guide has all the information you need for everything from reporting bugs to contributing entire new features. Please don't hesitate to jump in if you'd like to, or even ask us questions if something isn't clear.