clickhouse-backup - Backup and restore ClickHouse to S3

  •        56

Backup and restore ClickHouse to S3

https://github.com/AlexAkulov/clickhouse-backup

Tags
Implementation
License
Platform

   




Related Projects

Tabix - SQL Editor & Open source simple business intelligence for Clickhouse.

  •    Javascript

Tabix is a SQL Editor & Open source simple business intelligence for Clickhouse. No need to install, it works from the browser. It provides support to Draw charts, Maps of the world, Metrics RealTime charts from system.metrics, Displays database and tables as tree and lot more.

ClickHouse - Columnar DBMS and Real Time Analytics

  •    C++

ClickHouse is an open source column-oriented database management system capable of real time generation of analytical data reports using SQL queries. It is Linearly Scalable, Blazing Fast, Highly Reliable, Fault Tolerant, Data compression, Real time query processing, Web analytics, Vectorized query execution, Local and distributed joins. It can process hundreds of millions to more than a billion rows and tens of gigabytes of data per single server per second.

backup-manager - Database backup manager for dumping to and restoring databases from S3, Dropbox, FTP, SFTP, and Rackspace Cloud

  •    PHP

This package provides a framework-agnostic database backup manager for dumping to and restoring databases from S3, Dropbox, FTP, SFTP, and Rackspace Cloud. Watch a video tour showing the Laravel driver in action to give you an idea what is possible.

laravel-backup - A package to backup your Laravel app

  •    PHP

This Laravel package creates a backup of your application. The backup is a zipfile that contains all files in the directories you specify along with a dump of your database. The backup can be stored on any of the filesystems you have configured in Laravel 5. Feeling paranoid about backups? No problem! You can backup your application to multiple filesystems at once.


mgob - MongoDB dockerized backup agent. Runs schedule backups with retention, S3 & SFTP upload, notifications, instrumentation with Prometheus and more.

  •    Go

MGOB is a MongoDB backup automation tool built with golang. Its features include Schedule backups, Local backups retention, Upload to S3, Google Cloud and lot more. It is distributed as an Alpine Docker image.

Priam - Co-Process for backup/recovery, Token Management, and Centralized Configuration management for Cassandra

  •    Java

Priam is a process/tool that runs alongside Apache Cassandra to automate Backup and recovery, Token management, Seed discovery, Configuration, Support AWS environment. It supports Support multi-region Cassandra deployment in AWS via public IP, Backup throttling, Uses Snappy compression to compress backup data on the fly, Backup SSTables from local ephemeral disks to S3 and lot more.

pgbackrest - Reliable PostgreSQL Backup & Restore

  •    C

pgBackRest aims to be a simple, reliable backup and restore system that can seamlessly scale up to the largest databases and workloads. Instead of relying on traditional backup tools like tar and rsync, pgBackRest implements all backup features internally and uses a custom protocol for communicating with remote systems. Removing reliance on tar and rsync allows for better solutions to database-specific backup challenges. The custom remote protocol allows for more flexibility and limits the types of connections that are required to perform a backup which increases security.

Amanda - Network Backup Solution

  •    C

AMANDA, the Advanced Maryland Automatic Network Disk Archiver, is a backup system that allows the administrator of a LAN to set up a single master backup server to back up multiple hosts to a single large capacity tape or disk drive. Amanda uses native tools (such as GNUtar, dump) for backup and can back up a large number of workstations running multiple versions of Unix/Mac OS X/Linux/Windows.

backup - Easy full stack backup operations on UNIX-like systems.

  •    Ruby

This project is now in maintenance. No new features are planned. Backup is a system utility for Linux and Mac OS X, distributed as a RubyGem, that allows you to easily perform backup operations. It provides an elegant DSL in Ruby for modeling your backups. Backup has built-in support for various databases, storage protocols/services, syncers, compressors, encryptors and notifiers which you can mix and match. It was built with modularity, extensibility and simplicity in mind.

MySQL-backup-to-Amazon-S3 - Backup daily/weekly/monhtly all your MySQL databases to Amazon S3 via SH and s3cmd

  •    Shell

Amazon S3 can be an interestingly safe and cheap way to store your important data. Some of the most important data in the world is saved in... MySQL, and surely mine is quite important, so I needed such a script. If you have a 500mb database (that's 10 times larger than any small site), with the priciest plan, keeping 6 backups (two months, two weeks, two days) costs $0.42 a month ($0.14GB/month). With 99.999999999% durability and 99.99% availability. Uploads are free, downloads would happen only in case you actually need to retrieve the backup (which hopefully won't be needed, but first GB is free, and over that $0.12/GB).

laravel-backup - Backup and restore database support for Laravel 4 applications

  •    PHP

You can use the --keep-only-s3 option if you don't want to keep a local copy of the SQL dump. Uses the aws/aws-sdk-php-laravel package which needs to be configured.

flexbackup

  •    Perl

Flexible backup script. Easy to configure, uses dump/afio/tar/cpio/star/etc. backend. Backup levels as in dump. Configurable backup sets. Writes to tapes, on-disk archive files, or on-disk directory trees. rpm-mode for only changed/unowned files.

Areca Backup - Personnel Backup Solution

  •    Java

Areca Backup is an Open Source personal backup solution. It basically allows you to select a set of files / directories to back-up, choose where and how (as a simple file copy, as a zip archive, ...) they will be stored, and configure post-backup actions (like sending backup reports by email or launching custom shell scripts).

SQL Server S3 Backup

  •    

SQL Server command line backup tool that will perform full, differential and transaction log backups, zip them up and then upload to an Amazon S3 bucket.

Powershell Backup - A backup utility aggregator

  •    

Powershell Backup (psBackup) is a file copy and backup utility aggregator which aims to provide Sequential Full File Backups to compliment an existing backup solution.

SVN Backup Widget

  •    

Utility to create Subversion repository backups using the svnadmin dump command. This utility allows you to create profiles for different backup scenarios.

Barman - Backup and Recovery manager for PostgreSQL

  •    Python

Barman (Backup and Recovery Manager) is an open source administration tool for disaster recovery of PostgreSQL servers . It allows your organisation to perform remote backups of multiple servers in business critical environments and to help DBAs during the recovery phase. Its features include backup catalogues, incremental backup, retention policies, remote backup and recovery, archiving and compression of WAL files and backups.

sms-backup-plus - Backup Android SMS, MMS and call log to Gmail / Gcal / IMAP

  •    Java

This is a fork of the Android backup tool SMS Backup, where development has stopped a while ago. It uses Gmail to perform SMS, MMS and call log backups over the network. New restore feature. SMS stored on Gmail can be transferred back to the phone. This even works for users who have already created their backups with older versions of SMS Backup. Note: MMS are currently not restored.

restic - Fast, secure, efficient backup program

  •    Go

restic is a backup program that is fast, efficient and secure. Restic should be easy to configure and use, so that in the unlikely event of a data loss you can just restore it. It uses cryptography to guarantee confidentiality and integrity of your data.