gcs-resumable-upload - Upload a file to Google Cloud Storage with built-in resumable behavior

We have collection of more than 1 Million open source products ranging from Enterprise product to small libraries in all platforms. We aggregate information from all open source repositories. Search and find the best for your needs. Check out projects section.

gcs-resumable-upload - Upload a file to Google Cloud Storage with built-in resumable behavior

If somewhere during the operation, you lose your connection to the internet or your tough-guy brother slammed your laptop shut when he saw what you were uploading, the next time you try to upload to that file, it will resume automatically from where you left off.If your upload was interrupted, next time you run the code, we ask the API how much data it has already, then simply dump all of the data coming through the pipe that it already has.

https://github.com/stephenplusplus/gcs-resumable-upload

Dependencies:

buffer-equal : ^1.0.0

configstore : ^3.0.0

google-auto-auth : ^0.9.0

pumpify : ^1.3.3

request : ^2.81.0

stream-events : ^1.0.1

through2 : ^2.0.0

Tags	google gcloud storage gcs upload resumable
Implementation	Javascript
License	MIT
Platform	OS-Independent

Related Projects

tus-node-server - Node.js tus server

Javascript

tus is a new open protocol for resumable uploads built on HTTP. This is the tus protocol 1.0.0 node.js server implementation. ⚠️ Attention: We currently lack the resources to properly maintain tus-node-server. This has the unfortunate consequence that this project is in rather bad condition (out-dated dependencies, no tests for the S3 storage, no resumable uploads for the GCS storage etc). If you want to help us with tus-node-server, we are more than happy to assist you and welcome new contributors. In the meantime, we can recommend tusd as a reliable and production-tested tus server. Of course, you can use tus-node-server if it serves your purpose.

tus upload upload-server framework resumable protocol app api server

tus - Resumable File Uploads

tus is a protocol based on HTTP for resumable file uploads. Resumable means that an upload can be interrupted at any moment and can be resumed without re-uploading the previous data again. An interruption may happen willingly, if the user wants to pause, or by accident in case of an network issue or server outage.

file-upload resumable-file-upload file-transfer

tus-php - 🚀 A pure PHP server and client for the tus resumable upload protocol v1.0.0

tus is a HTTP based protocol for resumable file uploads. Resumable means you can carry on where you left off without re-uploading whole data again in case of any interruptions. An interruption may happen willingly if the user wants to pause, or by accident in case of a network issue or server outage. Pull the package via composer.

tus tus-protocol php71 file-upload resumable-upload tus-php

flow

Javascript

Flow.js is a JavaScript library providing multiple simultaneous, stable and resumable uploads via the HTML5 File API.The library is designed to introduce fault-tolerance into the upload of large files through HTTP. This is done by splitting each file into small chunks. Then, whenever the upload of a chunk fails, uploading is retried until the procedure completes. This allows uploads to automatically resume uploading after a network connection is lost either locally or to the server. Additionally, it allows for users to pause, resume and even recover uploads without losing state because only the currently uploading chunks will be aborted, not the entire upload.

flow.js flow resumable.js file-upload resumable-upload chunk-upload html5-upload javascript-upload upload

tus-js-client - A pure JavaScript client for the tus resumable upload protocol

Javascript

A pure JavaScript client for the tus resumable upload protocol which works in browser environments, Node.js, React Native and Apache Cordova. Please consult the documentation below for more details.

tus web browser reactnative cordova nodejs resumable upload protocol progress file

tus-resumable-upload-protocol - Open Protocol for Resumable File Uploads

The protocol is in the protocol.md file. It is rendered as HTML via Jekyll/Kramdown by the tus.io repository (type make preview there).

protocol tus resumable file-upload mit cross-platform http open-source

Uppy - The next open source file uploader for web browsers

Javascript

Uppy is (going to be) a sleek, modular file uploader that integrates seemlessly with any framework. It fetches files from local disk, Google Drive, Dropbox, Instagram, remote URLs, cameras and other exciting locations, and then uploads them to the final destination. It’s fast, easy to use and let's you worry about more important problems than building a file uploader.

tus resumable file-upload es6 modular resumable-file-upload

resumable

Javascript

Resumable.js is a JavaScript library providing multiple simultaneous, stable and resumable uploads via the HTML5 File API. The library is designed to introduce fault-tolerance into the upload of large files through HTTP. This is done by splitting each file into small chunks. Then, whenever the upload of a chunk fails, uploading is retried until the procedure completes. This allows uploads to automatically resume uploading after a network connection is lost either locally or to the server. Additionally, it allows for users to pause, resume and even recover uploads without losing state because only the currently uploading chunks will be aborted, not the entire upload.

html5 file upload

jQuery-File-Upload - File Upload widget with multiple file selection, drag&drop support, progress bar, validation and preview images, audio and video for jQuery

Javascript

File Upload widget with multiple file selection, drag&drop support, progress bar, validation and preview images, audio and video for jQuery. Supports cross-domain, chunked and resumable file uploads. Works with any server-side platform (Google App Engine, PHP, Python, Ruby on Rails, Java, etc.) that supports standard HTML form file uploads.

file upload widget multiple selection drag drop progress preview cross-domain cross-site chunk resume gae bootstrap

jQuery-File-Upload

Javascript

ng-flow - Flow.js html5 file upload extension on angular.js framework

Javascript

Direct Download Download a latest build from https://github.com/flowjs/ng-flow/releases it contains development and minified production files in dist/ directory, they are also concatenated with core flow.js library.

flow.js flow resumable.js resumable angular angular.js angular-upload file-upload upload angularjs angular-component

jquery-fileupload-rails - jQuery File Upload integrated for Rails

Javascript

jQuery-File-Plugin is a file upload plugin written by Sebastian Tschan. jQuery File Upload features multiple file selection, drag&drop support, progress bars and preview images for jQuery. Supports cross-domain, chunked and resumable file uploads and client-side image resizing. jquery-fileupload-rails is a library that integrates jQuery File Upload for Rails 3.1 Asset Pipeline (Rails 3.2 supported).

Meteor-Files - Upload files via DDP or HTTP to Meteor server FS, AWS, GridFS, DropBox or Google Drive

Javascript

Award winning, extremely fast and robust package for file uploading, managing and streaming (Audio & Video & Images), with support of server's file system (FS) or third party storage, like: AWS, DropBox, Google Storage, Google Drive, GridFS or any other with API. All PRs are always welcome on dev branch. Please, always give expressive description to your changes and additions.

meteor meteor-package meteor-files gridfs google-storage aws-s3 dropbox upload file-upload websockets http

goofys - a high-performance, POSIX-ish Amazon S3 file system written in Go

Goofys allows you to mount an S3 bucket as a filey system. It's a Filey System instead of a File System because goofys strives for performance first and POSIX second. Particularly things that are difficult to support on S3 or would translate into more than one round-trip would either fail (random writes) or faked (no per-file permission). Goofys does not have a on disk data cache (checkout catfs), and consistency model is close-to-open.

s3-bucket s3 posix filesystem posix-ish aws-s3 cloud-storage fuse gcs google-cloud-storage openstack-swift fuse-filesystem

MJDownload - A delightful framework for multifile resumable broken downloads.

Objective-C

A delightful framework for multifile resumable broken downloads.

network download

JTune - A high precision Java CMS optimizer

Python

JTune is a tool that will help you tune and troubleshoot a running JVM (Java 6 - Java 8) without restarting. It currently doesn't work with the G1 garbage collector, and will error out if this is detected. Tuning is based on two metrics: the aggregate time spent doing GCs, and the standard deviation of the GCs. Upon invocation, JTune captures the output of jstat for the given pid as well as the GC log data during the sample period.The easiest way to install JTune is via pip. A pip install will fetch the latest version of JTune from the PyPI repo.

meteor-slingshot - Upload files directly to AWS S3, Google Cloud Storage and others in meteor

Javascript

Direct and secure file-uploads to AWS S3, Google Cloud Storage and others. There are many many packages out there that allow file uploads to S3, Google Cloud and other cloud storage services, but they usually rely on the meteor apps' server to relay the files to the cloud service, which puts the server under unnecessary load.

mgob - MongoDB dockerized backup agent. Runs schedule backups with retention, S3 & SFTP upload, notifications, instrumentation with Prometheus and more.

MGOB is a MongoDB backup automation tool built with golang. Its features include Schedule backups, Local backups retention, Upload to S3, Google Cloud and lot more. It is distributed as an Alpine Docker image.

mongodb docker backup s3-storage sftp mongodb-tools database-tools backup-restore

Blob Transfer Utility for Windows Azure Blob Storage

Blob Transfer Utility is a GUI tool to upload and download thousands of small/large files to/from Windows Azure Blob Storage.

blob blob-storage download parallel storage transfer upload

Commandline Downloader from Azure Storage for Startup Task

Sometime it is needed to download compressed files from Azure Storage in a startup task and then unpackage them. This tool helps everyone in such a need. After upload is done, the same tool upload a text file back to Azure Storage to notify that download completed with progress.