mydumper - A better and Fast MySQL Dump

  •        354

Mydumper is a tool used for backing up MySQL database servers much faster than the mysqldump tool distributed with MySQL. It also has the capability to retrieve the binary logs from the remote server at the same time as the dump itself.

  • Parallelism (hence, speed) and performance (avoids expensive character set conversion routines, efficient code overall)
  • Easier to manage output (separate files for tables, dump metadata, etc, easy to view/parse data)
  • Consistency - maintains snapshot across all threads, provides accurate master and slave log positions, etc
  • Manageability - supports PCRE for specifying database and tables inclusions and exclusions

https://github.com/maxbube/mydumper
https://launchpad.net/mydumper

Tags
Implementation
License
Platform

   




Related Projects

db-dumper - Dump the contents of a database

  •    PHP

This repo contains an easy to use class to dump a database using PHP. Currently MySQL, PostgreSQL, SQLite and MongoDB are supported. Behind the scenes mysqldump, pg_dump, sqlite3 and mongodump are used. Spatie is a webdesign agency based in Antwerp, Belgium. You'll find an overview of all our open source projects on our website.

mysql2sqlite - Converts MySQL dump to SQLite3 compatible dump

  •    Awk

Converts MySQL dump to SQLite3 compatible dump (including MySQL KEY xxxxx statements from the CREATE block). The script is written in awk (tested with gawk, but should work with original awk, and the lightning fast mawk) and shall be fully POSIX compliant.

laravel-db-snapshots - Quickly dump and load databases

  •    PHP

This package provides Artisan commands to quickly dump and load databases in a Laravel application. This package supports MySQL, PostgreSQL and SQLite.

MySQL Control Center

  •    C++

MySQL Control Center is an excellent GUI front end for MySQL database creation and administration. It allows multiple concurrent MySQL server connections, MDI (or not under Linux), stored login credentials, point and click dump file imports and more.

Elasticsearch-Exporter - A small script to export data from one Elasticsearch cluster into another.

  •    Javascript

A command line script to import/export data from ElasticSearch to various other storage systems. This is a brand new implementation with lots of bugs and way too little time to test everything for one lonely developer, so please consider this beta at best and provide feedback, bug reports and maybe even patches.


Sequel Pro - MySQL Database management for Mac

  •    PHP

Sequel Pro is a fast, easy-to-use Mac database management application for working with MySQL databases. It gives you direct access to your MySQL databases on local and remote server. It supports Full table management including indexes and MySQL Views.

MySQL Workbench - Visual database design tool for MySQL

  •    C++

MySQL Workbench is a visual database design tool. The tool is specifically for designing MySQL database. MySQL Workbench provides DBAs and developers an integrated tools for Database Design & Modeling, Query browser, Database Administration.

MySqlBackup.NET - MySQL Backup Solution for C#, VB.NET, ASP.NET

  •    DotNet

A class for backup and restore of MySQL database in C#/VB.NET/ASP.NET and supports data of UTF8 characters.

MyPHPdumpTool (mpdt)

  •    PHP

MyPHPdumpTool is a fully customizable PHP (CLI) based MySQL dumping utility that can be configured via 'crontab' to do scheduled archiving and upload of any MySQL database-dump file to any FTP server.

ms2my: MSSQL to MySQL converter

  •    PHP

A tool that helps with MSSQL to MySQL converting/replicating (both csvamp;dump) under *nix.Possible to use it with crontab for regular data fetching.Keeping mySQL-based data warehouse refreshed could also be one of the possibilities of using this script.

Cobar - Proxy for sharding databases and tables

  •    Java

Cobar is a proxy for sharding databases and tables,compatible with MySQL protocal and MySQL SQL grama,underlying storage only support MySQL for support foreground business more simple,stable,efficient and safety。

MySQL-backup-to-Amazon-S3 - Backup daily/weekly/monhtly all your MySQL databases to Amazon S3 via SH and s3cmd

  •    Shell

Amazon S3 can be an interestingly safe and cheap way to store your important data. Some of the most important data in the world is saved in... MySQL, and surely mine is quite important, so I needed such a script. If you have a 500mb database (that's 10 times larger than any small site), with the priciest plan, keeping 6 backups (two months, two weeks, two days) costs $0.42 a month ($0.14GB/month). With 99.999999999% durability and 99.99% availability. Uploads are free, downloads would happen only in case you actually need to retrieve the backup (which hopefully won't be needed, but first GB is free, and over that $0.12/GB).

kingshard - A high-performance MySQL proxy

  •    Go

kingshard is a high-performance proxy for MySQL powered by Go. Just like other mysql proxies, you can use it to split the read/write sqls. Now it supports basic SQL statements (select, insert, update, replace, delete). The most important feature is the sharding function. Kingshard aims to simplify the sharding solution of MySQL. The Performance of kingshard is about 80% compared to connecting to MySQL directly.kingshard is under the Apache 2.0 license. See the LICENSE directory for details.

phpMyFAQ - phpMyFAQ - Open Source FAQ system for PHP and MySQL, PostgreSQL and other databases

  •    PHP

phpMyFAQ is a multilingual, completely database-driven FAQ-system. It supports various databases to store all data, PHP 5.6+ is needed in order to access this data. phpMyFAQ also offers a multi-language Content Management System with a WYSIWYG editor and an Image Manager, real time search support with Elasticsearch, flexible multi-user support with user and group based permissions on categories and records, a wiki-like revision feature, a news system, user-tracking, 40+ supported languages, enhanced automatic content negotiation, HTML5/CSS3 based responsive templates, PDF-support, a backup-system, a dynamic sitemap, related FAQs, tagging, RSS feeds, built-in spam protection systems, OpenLDAP and Microsoft Active Directory support, and an easy to use installation script. phpMyFAQ is only supported on PHP 5.6.0 and up, you need a database as well. Supported databases are MySQL, Percona Server, PostgreSQL, Microsoft SQL Server, SQLite3 and MariaDB. If you want to use Elasticsearch as main search engine, you need Elasticsearch 2.x as well. Check our detailed requirements on phpmyfaq.de for more information.

mysql2mongo - MySQL to MongoDB importer

  •    PHP

MySQL to MongoDB importer. The scripts are using simple relational to non-relational (r2n) mapping mechanism that should let You automagically convert Your MySQL database into MongoDB set of collections.

Ariejan's MySQL Backup Tool

  •    PHP

Ariejan's MySQL Backup Tool allows you to create regular backups of your MySQL Database without any interaction.

MySQL - World's most popular open source database

  •    C++

The MySQL database is the world's most popular open source database because of its consistent fast performance, high reliability and ease of use. It is used by individual Web developers as well as many of the world's largest and fastest-growing organizations to save time and money powering their high-volume Web sites.

MySQL Connector/J - Driver that implements the Java Database Connectivity (JDBC) API and also MySQL X DevAPI

  •    Java

MySQL provides connectivity for client applications developed in the Java programming language with MySQL Connector/J, a driver that implements the Java Database Connectivity (JDBC) API and also MySQL X DevAPI. MySQL Connector/J 8.0 is a JDBC Type 4 driver that is compatible with the JDBC 4.2 specification. The Type 4 designation means that the driver is a pure Java implementation of the MySQL protocol and does not rely on the MySQL client libraries.

HeidiSQL - A lightweight interface to MySQL

  •    Pascal

HeidiSQL is a lightweight, fast and flexible interface to the popular MySQL-Database. It allows you to browse and edit your databases, tables, views, stored routines and triggers from an intuitive Windows interface.

mysql_utils - Pinterest MySQL Management Tools

  •    Python

It is hoped that this code will be useful to you as an example of working implementations of DB tools. MySQL servers at Pinterest are launched, live, and die with only the rarest of configuration changes. Upgrading kernels, MySQL versions, and any other changes that would require a restart of the database are never done in-place. Instead, these actions are always performed through server replacements and failovers/slave promotions as needed. This choice has greatly simplified our automation by removing the need to manage intermediate state.






We have large collection of open source products. Follow the tags from Tag Cloud >>


Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.