wal-g - Archival and Restoration for Postgres

•    Go

---

WAL-G is an archival restoration tool for Postgres. WAL-G is the successor of WAL-E with a number of key differences. WAL-G uses LZ4, LZMA or Brotli compression, multiple processors and non-exclusive base backups for Postgres. More information on the design and implementation of WAL-G can be found on the Citus Data blog post "Introducing WAL-G by Citus: Faster Disaster Recovery for Postgres".

postgresql postgres backup archiving s3

paperless - Scan, index, and archive all of your paper documents

•    Python

---

It's been more than 5 years since I started this project on a whim as an effort to try to get a handle on the massive amount of paper I was dealing with in relation to various visa applications (expat life is complicated!) Since then, the project has exploded in popularity, so much so that it overwhelmed me and working on it stopped being "fun" and started becoming a serious source of stress. In an effort to fix this, I created the Paperless GitHub organisation, and brought on a few people to manage the issue and pull request load. Unfortunately, that model has proven to be unworkable too. With 23 pull requests waiting and 157 issues slowly filling up with confused/annoyed people wanting to get their contributions in, my whole "appoint a few strangers and hope they've got time" idea is showing my lack of foresight and organisational skill.

search ocr paper archiving documents

wal-e - Continuous Archiving for Postgres

•    Python

---

WAL-E is a program designed to perform continuous archiving of PostgreSQL WAL files and base backups. To correspond on using WAL-E or to collaborate on its development, do not hesitate to send mail to the mailing list at wal-e@googlegroups.com (archives and subscription settings). Github issues are also currently being used to track known problems, so please feel free to submit those.

backup backups postgresql postgres archiving s3 google-cloud-storage openstack-swift blob-store azure-blob replication recovery pitr

nb - CLI and local web plain text note‑taking, bookmarking, and archiving with linking, tagging, filtering, search, Git versioning & syncing, Pandoc conversion, + more, in a single portable script

•    Shell

---

and more, in a single portable script. nb creates notes in text-based formats like Markdown, Org, and LaTeX, can work with files in any format, can import and export notes to many document formats, and can create private, password-protected encrypted notes and bookmarks. With nb, you can write notes using Vim, Emacs, VS Code, Sublime Text, and any other text editor you like, as well as terminal and GUI web browsers. nb works in any standard Linux / Unix environment, including macOS and Windows via WSL. Optional dependencies can be installed to enhance functionality, but nb works great without them.

git vim shell bash markdown cli productivity sync command-line notebook notes archiving vscode pandoc bookmarks note-taking knowledge-base bookmark-manager notes-app zettelkasten terminal prompt emacs versioning syncing encryption bookmarking tagging tags archive

DSpace - Digital Asset Management

•    Java

---

DSpace open source software is a turnkey institutional repository application. It preserves and enables easy and open access to all types of digital content including text, images, moving images, mpegs and data sets.

repository digital-repository dms digital-asset-management archiving content-repository

Paperless-ng - A supercharged version of paperless: scan, index and archive all your physical documents

•    Python

---

Paperless is an application by Daniel Quinn and contributors that indexes your scanned documents and allows you to easily search for documents and store metadata alongside your documents. It performs OCR on your documents, adds selectable text to image only documents and adds tags, correspondents and document types to your documents. It supports PDF documents, images, plain text files, and Office documents (Word, Excel, Powerpoint, and LibreOffice equivalents).

search machine-learning django angular ocr archiving full-text-search dms document-management-system document-management

ResourceSpace - Digital Asset Management

•    PHP

---

ResourceSpace is a web-based, open source digital asset management system which has been designed to give your content creators easy and fast access to print and web ready assets. A centralised and well organised repository encourages the re-use of purchased resources.

repository digital-repository dms digital-asset-management archiving

SharePoint Backup Augmentation Cmdlets

•    

---

The SharePoint Backup Augmentation Cmdlets (SharePointBAC) provide administrators with additional PowerShell cmdlets to complement and extend SharePoint 2010's native backup and restore capabilities. SharePointBAC makes it possible to groom backup sets, archive backups, and more.

sharepoint administration archiving backup cmdlets grooming notifications

Mail 2 SharePoint (Upload email from Outlook to SharePoint)

•    

---

Use this Outlook 2007 Add-in to send emails to SharePoint libraries, saving custom properties, and then view the emails directly in the browser using the Mail2SharePoint Email Viewer web part. Share emails as a team, archive them to SharePoint, save to project sites.

archiving email integration outlook outlook-addin sharepoint sharepoint-2007

BizTalk Archiving - SQL and File

•    

---

BizTalk Message Archiving - it's a pipeline component that can be used for archiving incoming/outgoing message from any adapters. It provides an option to save the message to either file (local, shared, network) or in SQL Server.

archiving biztalk biztalk-2010 biztalk-tools pipeline-components pipeline-development

Disk Garden

•    DotNet

---

Disk Garden - program for cataloging disks (cd, dvd). Program scans disks and saves catalogs in one file. Disks can be segragate into categories (ex. movies, games). Folders and files can be tagged. It's similiar to Advanced Disk Catalog or WhereIsIt?.

archiving catalog catalogue cd desktop

Sharepoint Archiving To Folder System

•    

---

Many of the users are facing problem with the Sharepoint Library getting full. we have developed a solution which would help to archive the files based on date for any site. You can add the same folder path in search so that the users get the results of the files from folder.

archiving list listitem sharepoint-2010

grab-site - The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

•    Python

---

grab-site is an easy preconfigured web crawler designed for backing up websites. Give grab-site a URL and it will recursively crawl the site and write WARC files. Internally, grab-site uses wpull for crawling. a dashboard with all of your crawls, showing which URLs are being grabbed, how many URLs are left in the queue, and more.

archiving crawl spider crawler warc

pgbackrest - Reliable PostgreSQL Backup & Restore

•    C

---

pgBackRest aims to be a simple, reliable backup and restore system that can seamlessly scale up to the largest databases and workloads. Instead of relying on traditional backup tools like tar and rsync, pgBackRest implements all backup features internally and uses a custom protocol for communicating with remote systems. Removing reliance on tar and rsync allows for better solutions to database-specific backup challenges. The custom remote protocol allows for more flexibility and limits the types of connections that are required to perform a backup which increases security.

compression postgresql parallel backup restore archiving multi-process differential-backups database checksum tablespace s3

jarchivelib - A simple archiving and compression library for Java

•    Java

---

A simple library that facades org.apache.commons.compress, to provide an easy-to-use API for archiving and compressing into and out of File objects.

compression archiving extraction

irc-docs - Collected IRC protocol documentation

•    HTML

---

Collected IRC protocol documentation

irc history archiving

crocoite - Web archiving using Google Chrome

•    Python

---

Archive websites using headless Google Chrome and its DevTools protocol. A lot of sites need some form of interaction to dynamically load more content. Twitter for instance continously loads new posts when scrolling to the bottom of the page. crocoite can emulate these user interactions (and more) by combining control code written in Python and injecting JavaScript into the page. The code can be limited to certain URLs or apply to every page loaded. By default all scripts available are enabled, see command line flag --behavior.

warc chrome-browser archiving

ArchiveBot - ArchiveBot, an IRC bot for archiving websites

•    Python

---

ArchiveBot, an IRC bot for archiving websites

archiving irc

UnifiedArchive - UnifiedArchive - unified interface to all popular archive formats (zip, 7z, rar, gz, bz2, xz, cab, tar, tar

•    PHP

---

UnifiedArchive - unified interface to all popular archive formats (zip # 7z # rar # gz # bz2 # xz # cab # tar # tar.gz # tar.bz2 # tar.x # tar.Z # iso-9660) for listing, reading, extracting and creation + built-in console archive manager + PclZip-like interface for zip archives. If on your site there is a possibility of uploading of archives and you would like to add functionality of their automatic unpacking and viewing with no dependency on format of the archive, you can use this library.

tar zip rar archives archiving cab iso 7zip gzip bzip2 lzma2

mkstage4 - Bash Utility for Creating Stage 4 Tarballs

•    Shell

---

This is a bash script to create stage 4 tarballs either for the running system, or a system at a specified mount point. The script is a new edition of an earlier mkstage4 script by Greg Fitzgerald (unmaintained as of 2012) which is itself a revamped edition of the original mkstage4 by Reto Glauser (unmaintaied as of 2009). More information on mkstage4 can be found on its own Chymeric Tutorials article: mkstage4 - Stage 4 Tarballs Made Easy.

gentoo system-management backup archiving stage4