HPCC is a proven and battle-tested platform for manipulating, transforming, querying and data warehousing Big Data. It supports two type of configuration. Thor is responsible for consuming vast amounts of data, transforming, linking and indexing that data. It functions as a distributed file system with parallel processing power spread across the nodes. Roxie, the Data Delivery Engine, provides separate high-performance online query processing and data warehouse capabilities.
hadoop-alternative distributed-file-system map-reduce machine-learningApache Hadoop is a framework for running applications on large clusters built of commodity hardware. Hadoop common supports other Hadoop subprojects
cluster map-reduce distributed-file-systemFastDFS is an open source high performance distributed file system. It's major functions include: file storing, file syncing and file accessing (file uploading and file downloading), and it can resolve the high capacity and load balancing problem. FastDFS should meet the requirement of the website whose service based on files such as photo sharing site and video sharing site. FastDFS has two roles: tracker and storage. The tracker takes charge of scheduling and load balancing for file access. The storage store files and it's function is file management including: file storing, file syncing, providing file access interface. It also manage the meta data which are attributes representing as key value pair of the file. For example: width=1024, the key is "width" and the value is "1024".
distributed-file-system distributed-file-storage storage-serversMooseFS is a Petabyte Open Source Network Distributed File System. It is easy to deploy and maintain, fault tolerant, highly performing, easily scalable, POSIX compliant. MooseFS Linux Client uses FUSE. MooseFS macOS Client uses FUSE for macOS.
dfs software-defined-storage posix filesystem file-system distributed-file-system clustering distributed-storage distributed-computing fuse big-data snapshot storage-tiering high-availability scalability storage moosefs hadoop posix-compliantA distributed POSIX filesystem based on TiKV, with partition tolerance and strict consistency. You can use the image on docker hub or build from the Dockerfile.
distributed-systems fuse filesystem tikv distributed-file-system posix-compatible tifsDistributed KV Storage System based on Raft and RocksDB, can also be use to store small files, like images.
distributed-storage distributed-file-system distributed-file-storage raft rocksdb haystack distributed-kvThe most recent release of sfs is release-1.20170106133707. Oracle Java 8 and Maven 3 should be used for building.
distributed-storage distributed-systems vertx rxjava elasticsearch openstack-swift distributed-file-system object-storageYet Another File System (yfs) based on Paxos algorithm. This was the lab of MIT 6.824 course Distributed Systems before 2012.
distributed-file-systemThis repository contains instructions to build a private, unstructured data storage network for any blockchain on distributed file system, InterPlanetary File System for Business (IPFSfB), using crypto tools and Docker images with Docker and Docker Compose to provision the enterprise blockchain storage network. InterPlanetary File System for Business (IPFSfB) is based on InterPlanetary File System, which aim to provide an enterprise form, unstructured data storage network for any blockchain.
blockchain ipfs cryptography p2p protocol distributed-file-system networkingThis project written in Rust because it is giving real guaranties for preventing data races and completely handles memory management without garbage collection, which is giving huge performance improvements and low memory usage. Want to contribute to Rusix? Awesome! Check out the contributing guide.
distributed-file-systemDistributed file transfer application in user space. Securely move data files during distributed computational experiments and provide a global view of all files, even when there is no distributed filesystem and probably faster than NFS for large files.
ocaml privacy-protection distributed-file-system cryptography cli
We have large collection of open source products. Follow the tags from
Tag Cloud >>
Open source products are scattered around the web. Please provide information
about the open source projects you own / you use.
Add Projects.