gcs-resumable-upload - Upload a file to Google Cloud Storage with built-in resumable behavior

  •        120

If somewhere during the operation, you lose your connection to the internet or your tough-guy brother slammed your laptop shut when he saw what you were uploading, the next time you try to upload to that file, it will resume automatically from where you left off.If your upload was interrupted, next time you run the code, we ask the API how much data it has already, then simply dump all of the data coming through the pipe that it already has.

https://github.com/stephenplusplus/gcs-resumable-upload

Dependencies:

buffer-equal : ^1.0.0
configstore : ^3.0.0
google-auto-auth : ^0.9.0
pumpify : ^1.3.3
request : ^2.81.0
stream-events : ^1.0.1
through2 : ^2.0.0

Tags
Implementation
License
Platform

   




Related Projects

tus-node-server - Node.js tus server

  •    Javascript

tus is a new open protocol for resumable uploads built on HTTP. This is the tus protocol 1.0.0 node.js server implementation. ⚠️ Attention: We currently lack the resources to properly maintain tus-node-server. This has the unfortunate consequence that this project is in rather bad condition (out-dated dependencies, no tests for the S3 storage, no resumable uploads for the GCS storage etc). If you want to help us with tus-node-server, we are more than happy to assist you and welcome new contributors. In the meantime, we can recommend tusd as a reliable and production-tested tus server. Of course, you can use tus-node-server if it serves your purpose.

tus - Resumable File Uploads

  •    Go

tus is a protocol based on HTTP for resumable file uploads. Resumable means that an upload can be interrupted at any moment and can be resumed without re-uploading the previous data again. An interruption may happen willingly, if the user wants to pause, or by accident in case of an network issue or server outage.

tus-php - 🚀 A pure PHP server and client for the tus resumable upload protocol v1.0.0

  •    PHP

tus is a HTTP based protocol for resumable file uploads. Resumable means you can carry on where you left off without re-uploading whole data again in case of any interruptions. An interruption may happen willingly if the user wants to pause, or by accident in case of a network issue or server outage. Pull the package via composer.

flow

  •    Javascript

Flow.js is a JavaScript library providing multiple simultaneous, stable and resumable uploads via the HTML5 File API.The library is designed to introduce fault-tolerance into the upload of large files through HTTP. This is done by splitting each file into small chunks. Then, whenever the upload of a chunk fails, uploading is retried until the procedure completes. This allows uploads to automatically resume uploading after a network connection is lost either locally or to the server. Additionally, it allows for users to pause, resume and even recover uploads without losing state because only the currently uploading chunks will be aborted, not the entire upload.

tus-js-client - A pure JavaScript client for the tus resumable upload protocol

  •    Javascript

A pure JavaScript client for the tus resumable upload protocol which works in browser environments, Node.js, React Native and Apache Cordova. Please consult the documentation below for more details.


tus-resumable-upload-protocol - Open Protocol for Resumable File Uploads

  •    

The protocol is in the protocol.md file. It is rendered as HTML via Jekyll/Kramdown by the tus.io repository (type make preview there).

Uppy - The next open source file uploader for web browsers

  •    Javascript

Uppy is (going to be) a sleek, modular file uploader that integrates seemlessly with any framework. It fetches files from local disk, Google Drive, Dropbox, Instagram, remote URLs, cameras and other exciting locations, and then uploads them to the final destination. It’s fast, easy to use and let's you worry about more important problems than building a file uploader.

resumable

  •    Javascript

Resumable.js is a JavaScript library providing multiple simultaneous, stable and resumable uploads via the HTML5 File API. The library is designed to introduce fault-tolerance into the upload of large files through HTTP. This is done by splitting each file into small chunks. Then, whenever the upload of a chunk fails, uploading is retried until the procedure completes. This allows uploads to automatically resume uploading after a network connection is lost either locally or to the server. Additionally, it allows for users to pause, resume and even recover uploads without losing state because only the currently uploading chunks will be aborted, not the entire upload.

jQuery-File-Upload - File Upload widget with multiple file selection, drag&drop support, progress bar, validation and preview images, audio and video for jQuery

  •    Javascript

File Upload widget with multiple file selection, drag&drop support, progress bar, validation and preview images, audio and video for jQuery. Supports cross-domain, chunked and resumable file uploads. Works with any server-side platform (Google App Engine, PHP, Python, Ruby on Rails, Java, etc.) that supports standard HTML form file uploads.

jQuery-File-Upload

  •    Javascript

File Upload widget with multiple file selection, drag&drop support, progress bar, validation and preview images, audio and video for jQuery. Supports cross-domain, chunked and resumable file uploads. Works with any server-side platform (Google App Engine, PHP, Python, Ruby on Rails, Java, etc.) that supports standard HTML form file uploads.

ng-flow - Flow.js html5 file upload extension on angular.js framework

  •    Javascript

Direct Download Download a latest build from https://github.com/flowjs/ng-flow/releases it contains development and minified production files in dist/ directory, they are also concatenated with core flow.js library.

jquery-fileupload-rails - jQuery File Upload integrated for Rails

  •    Javascript

jQuery-File-Plugin is a file upload plugin written by Sebastian Tschan. jQuery File Upload features multiple file selection, drag&drop support, progress bars and preview images for jQuery. Supports cross-domain, chunked and resumable file uploads and client-side image resizing. jquery-fileupload-rails is a library that integrates jQuery File Upload for Rails 3.1 Asset Pipeline (Rails 3.2 supported).

Meteor-Files - Upload files via DDP or HTTP to Meteor server FS, AWS, GridFS, DropBox or Google Drive

  •    Javascript

Award winning, extremely fast and robust package for file uploading, managing and streaming (Audio & Video & Images), with support of server's file system (FS) or third party storage, like: AWS, DropBox, Google Storage, Google Drive, GridFS or any other with API. All PRs are always welcome on dev branch. Please, always give expressive description to your changes and additions.

goofys - a high-performance, POSIX-ish Amazon S3 file system written in Go

  •    Go

Goofys allows you to mount an S3 bucket as a filey system. It's a Filey System instead of a File System because goofys strives for performance first and POSIX second. Particularly things that are difficult to support on S3 or would translate into more than one round-trip would either fail (random writes) or faked (no per-file permission). Goofys does not have a on disk data cache (checkout catfs), and consistency model is close-to-open.

MJDownload - A delightful framework for multifile resumable broken downloads.

  •    Objective-C

A delightful framework for multifile resumable broken downloads.

JTune - A high precision Java CMS optimizer

  •    Python

JTune is a tool that will help you tune and troubleshoot a running JVM (Java 6 - Java 8) without restarting. It currently doesn't work with the G1 garbage collector, and will error out if this is detected. Tuning is based on two metrics: the aggregate time spent doing GCs, and the standard deviation of the GCs. Upon invocation, JTune captures the output of jstat for the given pid as well as the GC log data during the sample period.The easiest way to install JTune is via pip. A pip install will fetch the latest version of JTune from the PyPI repo.

meteor-slingshot - Upload files directly to AWS S3, Google Cloud Storage and others in meteor

  •    Javascript

Direct and secure file-uploads to AWS S3, Google Cloud Storage and others. There are many many packages out there that allow file uploads to S3, Google Cloud and other cloud storage services, but they usually rely on the meteor apps' server to relay the files to the cloud service, which puts the server under unnecessary load.

mgob - MongoDB dockerized backup agent. Runs schedule backups with retention, S3 & SFTP upload, notifications, instrumentation with Prometheus and more.

  •    Go

MGOB is a MongoDB backup automation tool built with golang. Its features include Schedule backups, Local backups retention, Upload to S3, Google Cloud and lot more. It is distributed as an Alpine Docker image.

Blob Transfer Utility for Windows Azure Blob Storage

  •    

Blob Transfer Utility is a GUI tool to upload and download thousands of small/large files to/from Windows Azure Blob Storage.

Commandline Downloader from Azure Storage for Startup Task

  •    

Sometime it is needed to download compressed files from Azure Storage in a startup task and then unpackage them. This tool helps everyone in such a need. After upload is done, the same tool upload a text file back to Azure Storage to notify that download completed with progress.





We have large collection of open source products. Follow the tags from Tag Cloud >>


Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.