pegasus-rocksdb - pegasus-rocksdb

  •        11

This code is a library that forms the core building block for a fast key value server, especially suited for storing data on flash drives. It has a Log-Structured-Merge-Database (LSM) design with flexible tradeoffs between Write-Amplification-Factor (WAF), Read-Amplification-Factor (RAF) and Space-Amplification-Factor (SAF). It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database. See the github wiki for more explanation.

https://github.com/XiaoMi/pegasus-rocksdb

Tags
Implementation
License
Platform

   




Related Projects

pegasus

  •    C++

Pegasus is a distributed key-value storage system developed and maintained by Xiaomi Cloud Storage Team, with targets of high availability, high performance, strong consistency and ease of use. The original motivation of this project is to replace Apache HBase for users who only need simple key-value schema but require low latency and high availability. It is based on the open source rDSN framework, and uses modified RocksDB as underlying storage engine. The consensus algorithm it uses is PacificA. Unlike Bigtable/HBase, a non-layered replication archiecture is adopted in pegasus in which an external DFS like GFS/HDFS isn't the dependency of the persistent data, which benefits the availablity a lot. Meanwhile, availablity problems in HBase which result from Java GC are totally eliminated for the use of C++.

Pegasus Library

  •    CSharp

The Pegasus Library is a collection of .NET classes that augments the .NET framework with helper classes and services.

Linux Pegasus USB-Ethernet drv

  •    C

The idea is to get all pegasus and pegasus II based usb-ethernet devices to work under linux. That simple. :)

pegasus

  •    Python

Pre-training with Extracted Gap-sentences for Abstractive SUmmarization Sequence-to-sequence models, or PEGASUS, uses self-supervised objective Gap Sentences Generation (GSG) to train a transformer encoder-decoder model. The paper can be found on arXiv. ICML 2020 accepted. We train a pegasus model with sampled gap sentence ratios on both C4 and HugeNews, and stochastically sample important sentences. The updated the results are reported in this table.

S/MIME Plugin for Pegasus Mail

  •    C++

A Plugin for Pegasus Mail, supporting S/MIME Encryption, Decryption, Signing and Signature verifying. In addition, key management is provided.


AntiSpam Plugin for Pegasus Mail

  •    C++

AntiSpam is an extension for Pegasus Mail 3.1 (and above) by David Harris. It semi-automates the process of complaining about unsolicited mail (aka quot;spamquot;).

pegasus - Load JSON while still loading other scripts

  •    Javascript

Pegasus is a tiny lib that lets you load JSON data while loading other scripts.If you have a static website, using this technique, you can reduce the time to display data. Works with any JS lib (React, Vue, jQuery, ...).

Mac OS X Pegasus USB-To-Ethernet Driver

  •    

A Mac OS X Driver for USB-To-Etherenet devices based on the AdmTek Pegasus Chipset.

Pegasus Mail 2 KMail

  •    C++

Convert Pegasus mail folders (message status included) to use with KMail

Pegasus Trading for FOREX

  •    Java

A complete Spot Foreign Currency Trading Platform (Client/Server) to act as an ECN and a Merket Maker. Written entirely in Java and using Java Servlets with JDBC for database access.

mvt - MVT (Mobile Verification Toolkit) helps conducting forensics of mobile devices in order to find signs of a potential compromise

  •    Python

Mobile Verification Toolkit (MVT) is a collection of utilities to simplify and automate the process of gathering forensic traces helpful to identify a potential compromise of Android and iOS devices. It has been developed and released by the Amnesty International Security Lab in July 2021 in the context of the Pegasus project along with a technical forensic methodology and forensic evidence.

ardb - A redis protocol compatible nosql, it support multiple storage engines as backend like Google's LevelDB, Facebook's RocksDB, OpenLDAP's LMDB, PerconaFT, WiredTiger, ForestDB

  •    C++

Ardb is a BSD licensed, redis-protocol compatible persistent nosql, it support multiple storage engines as backend like Google's LevelDB, Facebook's RocksDB, OpenLDAP's LMDB, WiredTiger, PerconaFT,Couchbase's ForestDB the default backend is Facebook's RocksDB. Rocksdb is the default storage engine, to compile with rocksdb, just type make to compile server & lib & tests.

gorocksdb - gorocksdb is a Go wrapper for RocksDB

  •    Go

You'll need to build RocksDB v5.5+ on your machine. Please note that this package might upgrade the required RocksDB version at any moment. Vendoring is thus highly recommended if you require high stability.

rust-rocksdb - rust wrapper for rocksdb

  •    Rust

Feedback and pull requests welcome! If a particular feature of RocksDB is important to you, please let me know by opening an issue, and I'll prioritize it.

rust-rocksdb - rust wrapper for rocksdb

  •    Rust

Feedback and pull requests welcome! If a particular feature of RocksDB is important to you, please let me know by opening an issue, and I'll prioritize it.

titan - A RocksDB plugin for key-value separation, inspired by WiscKey.

  •    C++

Titan is a RocksDB Plugin for key-value separation, inspired by WiscKey. For introduction and design details, see our blog post. Titan relies on RocksDB source code to build. You need to checkout RocksDB source code locally, and provide the path to Titan build script.

Xiaomi-cloud-tokens-extractor - This tool/script retrieves tokens for all devices connected to Xiaomi cloud and encryption keys for BLE devices

  •    Python

This tool/script retrieves tokens for all devices connected to Xiaomi cloud and encryption keys for BLE devices. In return all of your devices connected to account will be listed, together with their name and IP address.

RocksDB - A persistent key-value store for fast storage environments

  •    C++

RocksDB is an embeddable persistent key-value store for fast storage. RocksDB builds on LevelDB to be scalable to run on servers with many CPU cores, to efficiently use fast storage, to support IO-bound, in-memory and write-once workloads, and to be flexible to allow for innovation. It is especially suited for storing data on flash drives. It has multi-threaded compactions, making it specially suitable for storing multiple terabytes of data in a single database.

FastoNoSQL - Cross platform Redis, Memcached, SSDB, LevelDB, RocksDB, UnQLite, LMDB, ForestDB, Pika, Dynomite GUI management tool

  •    C++

FastoNoSQL — is a crossplatform Redis, Memcached, SSDB, LevelDB, RocksDB, UnQLite, LMDB, UpscaleDB, ForestDB, Pika management tool, also FastoNoSQL is platform for NoSQL databases, you can add your own implementation for different databases.

TerarkDB - High performance database with the best compression

  •    C++

TerarkDB is a core product of Terark. It is a RocksDB distribution that powered by Terark algorithms. with these algorithms, TerarkDB is able to store more data and access much faster than official RocksDB(3+X more data and 10+X faster) on same hardware.






We have large collection of open source products. Follow the tags from Tag Cloud >>


Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.