Displaying 1 to 20 from 20 results

bookmark-archiver - 🗄 Save an archived copy of all websites starred using Pocket/Pinboard/Bookmarks

  •    Python

Save an archived copy of all websites you bookmark (the actual content of each site, not just the list of bookmarks).Outputs browsable static html archives of each site, a PDF, a screenshot, and a link to a copy on archive.org, all indexed with nice html & json files.

HTTPie - a CLI, cURL-like tool for humans

  •    Python

HTTPie (pronounced aitch-tee-tee-pie) is a command line HTTP client. Its goal is to make CLI interaction with web services as human-friendly as possible. It provides a simple http command that allows for sending arbitrary HTTP requests using a simple and natural syntax, and displays colorized output. HTTPie can be used for testing, debugging, and generally interacting with HTTP servers.

ArchiveBox - 🗃 Open source self-hosted web archiving

  •    Python

ArchiveBox is a powerful, self-hosted internet archiving solution to collect, save, and view sites you want to preserve offline. You can set it up as a command-line tool, web app, and desktop app (alpha), on Linux, macOS, and Windows.

GOT - Human-friendly and powerful HTTP request library for Node.js

  •    Typescript

Human-friendly and powerful HTTP request library for Node.js. It is almost API compatible with the browser fetch API. It supports Promise API, Stream API, HTTPS/2 support, Progress events and Hooks.

urllib - Request HTTP(s) URLs in a complex world.

  •    Javascript

Request HTTP URLs in a complex world — basic and digest authentication, redirections, cookies, timeout and more. If you've installed bluebird, bluebird will be used. urllib does not install bluebird for you.

wsend - wsend: The opposite of wget

  •    Shell

wsend is a Command Line Tool (CLI) for sending files. It's open-source and easy to use. We've designed wsend to be suitable for command line beginners and well seasoned users alike. wsend uses wsend.net for backend file handling.

gofret - gofret is a Download Manager written in Go.

  •    Go

Gofret is a Download Manager written in Go. Gofret, wget like a download manager. But simple and amateur.

cliget - A Firefox addon to download login-protected files from the command line

  •    Javascript

Download login-protected files from the command line using curl, wget or aria2. This addon will generate commands that emulate the request as though it was coming from your browser by sending the same cookies, user agent string and referrer. With this addon you can download email attachments, purchased software/media, source code from a private repository to a remote server without having to download the files locally first. If come across a website where cliget doesn't work, please open an issue providing details to help reproduce the problem.

rackula - Generate a static site from any rack middleware.

  •    Ruby

Rackula will immortalize your rackup web app by generating a static copy. It can be used to generate a static site from any rack-compatible middleware (e.g. rails, sinatra, utopia). Ensure that wget is installed and available.

grunt-wget - Wget plugin for Grunt.

  •    Javascript

Wget plugin for Grunt. Run this task with the grunt wget command.

gdown.pl - Google Drive direct download of big files

  •    Perl

wget and Perl must be in the PATH. Windows and linux compatible.

bin - 💻 Automatically download latest GitHub release binaries (for your OS/arch) using wget or curl

  •    Go

This is a simple server (deployed @ https://bin.suyash.io) that makes it easy to download the latest binary associated with any GitHub repo release using regular old wget and curl. It attempts to use your User-Agent to fetch the right GitHub release asset for your OS/arch, but also lets you provide query parameters to specify OS/arch, and optionally uncompress the release artifact on the fly. I mostly just built this as a way to distribute my software binaries easily without dealing with brew, npm, etc (though they certainly have their advantages & trust). I can just give my users a one line download link that will always get them the latest released binary for their platform, and all I have to do is just update GitHub releases like I normally do.

squirrel - Like curl, or wget, but downloads directly go to a SQLite databse

  •    Go

Downloading the web can be cumbersome if you end up with thousands or millions of files. This tool allows you to download websites directly into a file-based database in SQLite, since SQlite performs faster than a filesystem for reading and writing. It should be compatible with Firefox's "Copy as cURL", just replace curl with squirrel. By default it will save the data in a database, urls.db.

gdown - Download a large file from Google Drive (curl/wget fails because of the security notice).

  •    Python

Download a large file from Google Drive. If you use curl/wget, it fails with a large file because of the security warning from Google Drive. See LICENSE.

rget - A download accelerator written in Rust

  •    Rust

This program is a download accelerator primarily inspired by huydx/hget. Essentially, I was bored one night and now here we are. Barring any bugs, rget should work on both Windows and Unix-like platforms. In addition to incomplete features, because rget is in very early stages of development, there will likely be bugs. If you encounter any please let me know or submit a pull request squashing the bug so we can all download files worry-free.

fugot - Like `got` but with futures

  •    Javascript

This library is a port of the excellent got Node HTTP client that returns Futures instead of Promises, provided by the also excellent Fluture library. Please note that unlike got, fugot does not support streams as it's focused on being a Future-returning client for Node.

xidel - A command line tool to download and extract data from HTML/XML pages or JSON-APIs, using CSS, XPath 3

  •    Pascal

Xidel is a command line tool to download and extract data from HTML/XML pages using CSS selectors, XPath/XQuery 3.0, as well as querying JSON files or APIs (e.g. REST) using JSONiq. There are dependency-free binaries for Windows, Linux and Mac.

cl-wget - The Non-Interactive Network Downloader: cl-wget is a free software for retrieving files using HTTPS; cl-wget makes mirroring websites easy

  •    Common

This file documents the cl-wget utility for downloading network data. Only the most basic functionalities have been ported. Refer to GNU Wget 1.21.1-dirty Manual as inspiration for development. cl-wget is a free software for non-interactive download of files from the Web.

We have large collection of open source products. Follow the tags from Tag Cloud >>

Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.