skipper-s3 - Streaming file uploads to S3

  •        99

S3 adapter for receiving upstreams. Particularly useful for handling streaming multipart file uploads from the Skipper body parser.Also make sure you have skipper itself installed as your body parser. This is the default configuration in Sails as of v0.10.

https://github.com/balderdashy/skipper-s3

Dependencies:

concat-stream : 1.6.0
fs-extra : 0.30.0
knox : 0.8.10
knox-mpu-alt : 0.2.1
lodash : 3.10.1
merge-defaults : 0.1.4
mime : 1.2.11
s3-lister : 0.1.0

Tags
Implementation
License
Platform

   




Related Projects

skipper - Streaming multi-uploads for Sails/Express - supports disk, S3, gridfs, and custom file adapters

  •    Javascript

Skipper makes it easy to implement streaming file uploads to disk, S3, or any supported file upload adapters.The following example assumes skipper is already installed as the body parser in your Express or Sails app. It receives one or more files from a file parameter named avatar using the default, built-in file adapter (skipper-disk). This streams the file(s) to the default upload directory .tmp/uploads/ on the server's local disk.

s3-upload-stream - A Node.js module for streaming data to Amazon S3 via the multipart upload API

  •    Javascript

A pipeable write stream which uploads to Amazon S3 using the multipart file upload API. NOTE: This module is deprecated after the 2.1.0 release of the AWS SDK on Dec 9, 2014, which added S3.upload(). I highly recommend switching away from this module and using the official method supported by AWS.

Meteor-Files - Upload files via DDP or HTTP to Meteor server FS, AWS, GridFS, DropBox or Google Drive

  •    Javascript

Award winning, extremely fast and robust package for file uploading, managing and streaming (Audio & Video & Images), with support of server's file system (FS) or third party storage, like: AWS, DropBox, Google Storage, Google Drive, GridFS or any other with API. All PRs are always welcome on dev branch. Please, always give expressive description to your changes and additions.

smart_open - Utils for streaming large files (S3, HDFS, gzip, bz2...)

  •    Python

There are a few optional keyword arguments that are useful only for S3 access. These are both passed to boto.s3_connect() as keyword arguments. The S3 reader supports gzipped content, as long as the key is obviously a gzipped file (e.g. ends with ".gz").

django-s3direct - Add direct uploads to S3 with a progress bar to file input fields

  •    Javascript

Add direct uploads to AWS S3 functionality with a progress bar to file input fields. With 1.0.0 supporting multipart-upload, most of the internals have been changed, a new endpoint has been added, and support has been dropped for old style positional settings. There are also new requirements to allow GET and HEAD cross-origin requests to S3, as well as the ETAG header. Django compatibility has been raised to >=1.8.


Flajaxian S3 Amazon Service Uploader

  •    CSharp

Flajaxian S3 Amazon Service Uploader is adapter for the Flajaxian FileUploader .NET web control designed for asynchronous file upload to an Amazon Service of multiple files at the same time, without a page post back and with a progress bar indicating the current upload progres...

arc - :paperclip: Flexible file upload and attachment library for Elixir

  •    Elixir

Arc is a flexible file upload library for Elixir with straightforward integrations for Amazon S3 and ImageMagick. Browse the readme below, or jump to a full example.

Nuage - A Dropbox-like interface for your existing data (with support for many backends)

  •    Javascript

A Dropbox-like file manager that let you manage your data anywhere it is located. It could be FTP, SFTP, WebDAV, Git, S3, Minio, Dropbox, Google Drive. It helps to manage your files from a browser, Upload files and folders, Audio player, Video player, Image viewer and lot more.

react-native-aws3 - Pure JavaScript React Native library for uploading to AWS S3

  •    Javascript

React Native AWS3 is a module for uploading files to S3. Unlike other libraries out there, there are no native dependencies. Upload a file to S3.

s3-plugin-webpack - Uploads files to s3 after complete

  •    Javascript

I notice a lot of people are setting the directory option when the files are part of their build. Please don't set directory if you're uploading your build. Using the directory option reads the files after compilation to upload instead of from the build process. include and exclude rules behave similarly to Webpack's loader options. In addition to a RegExp you can pass a function which will be called with the path as its first argument. Returning a truthy value will match the rule. You can also pass an Array of rules, all of which must pass for the file to be included or excluded.

fine-uploader - Multiple file upload plugin with image previews, drag and drop, progress bars

  •    Javascript

FineUploader is also simple to use. In the simplest case, you only need to include one JavaScript file. There are absolutely no other required external dependencies. For more information, please see the documentation. If you'd like to help and keep this project strong and relevant, you have several options.

meteor-slingshot - Upload files directly to AWS S3, Google Cloud Storage and others in meteor

  •    Javascript

Direct and secure file-uploads to AWS S3, Google Cloud Storage and others. There are many many packages out there that allow file uploads to S3, Google Cloud and other cloud storage services, but they usually rely on the meteor apps' server to relay the files to the cloud service, which puts the server under unnecessary load.

multer-s3 - multer storage engine for amazon s3

  •    Javascript

Streaming multer storage engine for AWS S3. This project is mostly an integration piece for existing code samples from Multer's storage engine documentation with s3fs as the substitution piece for file system. Existing solutions I found required buffering the multipart uploads into the actual filesystem which is difficult to scale.

Amazon S3 Upload with Uploadify

  •    

ASP.MVC upload file from client browser direct to Amazon S3

s3_direct_upload - Direct Upload to Amazon S3 With CORS

  •    Ruby

Easily upload files directly to Amazon S3. Multi file uploading supported by jquery-fileupload. Code extracted from Ryan Bates' gallery-jquery-fileupload.

instant.io - Streaming file transfer over WebTorrent (torrents on the web)

  •    Javascript

Download/upload files using the WebTorrent protocol (BitTorrent over WebRTC). Powered by WebTorrent, the first torrent client that works in the browser without plugins. WebTorrent is powered by JavaScript and WebRTC. Supports Chrome, Firefox, Opera (desktop and Android).

p5.js-web-editor - In progress p5.js web editor, coming soon.

  •    Javascript

This project is currently in development! It will be announced when there is a (public) beta release.If you don't care about being able to upload media files to S3 or Login with Github, you can drop in the file exactly how it is. Or, if you don't want to do that, just ask me to send you mine. Refer to this gist for creating an S3 bucket for testing, or if you don't want to do that, I can add you to one of my S3 buckets.

tinys3 - A simple python S3 upload library. Inspired by requests

  •    Python

A simple Python S3 upload library. Inspired by one of my favorite packages, requests. tinys3 is used at Smore to upload more than 1.5 million keys to S3 every month.

react-fine-uploader - Easily integrate Fine Uploader or Fine Uploader S3 into a React app

  •    Javascript

Makes using Fine Uploader in a React app simple. Drop-in high-level components for a turn-key UI. Use small focused components to build a more custom UI. These allow you to easily build a highly customizable and powerful UI for your upload widget, backed by Fine Uploader's core feature set. Most of these components are unstyled (i.e. ready to be styled by you). Focused component-specific stylesheets may be provided at a later date.

aws-lambda-redshift-loader - Amazon Redshift Database Loader implemented in AWS Lambda

  •    Javascript

With this AWS Lambda function, it's never been easier to get file data into Amazon Redshift. You simply push files into a variety of locations on Amazon S3, and have them automatically loaded into your Amazon Redshift clusters.For automated delivery of streaming data to S3 and subsequently to Redshift, also consider using Amazon Kinesis Firehose.