allitebooks-downloader - 📚Scrapes and downloads all IT eBooks

  •        162

This will create a folder for each eBook containing the eBook itself (pdf or zip file) and a txt file containing a description text of the book.

https://github.com/thomasbrueggemann/allitebooks-downloader#readme
https://github.com/thomasbrueggemann/allitebooks-downloader

Dependencies:

await-fs : ^1.0.0
cheerio : ^1.0.0-rc.2
download : ^6.2.5
make-dir : ^1.2.0
progress : ^2.0.0
request : ^2.83.0
request-promise-native : ^1.0.5

Tags
Implementation
License
Platform

   




Related Projects

heroku_ebooks - A script to generate Markov chains and to post to an _ebooks account on Twitter using Heroku

  •    Python

This is a basic Python port of @harrisj's iron_ebooks Ruby script. Using Heroku's scheduler, you can post to an _ebooks Twitter account based on the corpus of an existing Twitter at pseudorandom intervals. Currently, it is the magic behind @adriennelaf_ebx and @stevebuttry_ebx, among many, many others in the wild. This project should work in the latest releases of Python 2.7 and Python 3. By default, in Heroku, this will be deployed to Python 3.

node-ytdl-core - Youtube downloader in javascript.

  •    HTML

Yet another youtube downloading module. Written with only Javascript and a node-friendly streaming interface. For a CLI version of this, check out ytdl and pully.

Lulu - [Unmaintained] A simple and clean video/music/image downloader 👾

  •    Python

Sorry for this. Lulu is a friendly you-get fork (⏬ Dumb downloader that scrapes the web).

annie - 👾 Fast, simple and clean video downloader

  •    Go

👾 Annie is a fast, simple and clean video downloader built with Go. The following dependencies are required and must be installed separately.

InstaLooter - Another API-less Instagram pictures and videos downloader.

  •    Python

Not all treasure's silver and gold, mate. InstaLooter is a program that can download any picture or video associated from an Instagram profile, without any API access. It can be seen as a re-implementation of the now deprecated InstaRaider developed by @akurtovic.


Free-Security-eBooks - Free Security and Hacking eBooks

  •    

A curated list of free Security and Pentesting related E-Books available on the Internet. If you want to contribute to this list (please do), send a pull request. All contributors will be recognized and appreciated.

kindlefodder - Bring web docs to the Kindle

  •    Ruby

Kindlefodder is a Ruby framework and a collection of recipes for translating website-bound books and documentation into Kindle ebooks that are easy to navigate and a pleasure to peruse. Web browsers are good for scanning information, but Kindles are a lot better when you want to block out distractions and actually learn something. The ebooks posted here will in most cases be derived from material published under a Creative Commons license. I am grateful to the original authors for writing such good and useful material. They are welcome to take these ebooks and recipes, modify them, and distribute them under their own name.

scrape-it - :crystal_ball: A Node.js scraper for humans.

  •    Javascript

A Node.js scraper for humans. Please post questions on Stack Overflow. You can open issues with questions, as long you add a link to your Stack Overflow question.

node-ytdl - Command line youtube video downloader.

  •    Javascript

A youtube downloader written in Javascript. To be used with the command line. If you're looking to use it in your node program, check out ytdl-core.

PythonBooks - Directory of free Python ebooks

  •    Javascript

Directory of free Python ebooks

library - A library of free eBooks we're working on

  •    Javascript

A library of free eBooks we're working on

library - A library of free eBooks we're working on

  •    Javascript

A library of free eBooks we're working on

calibre-web - :books: Web app for browsing, reading and downloading eBooks stored in a Calibre database

  •    Python

Calibre-Web is a web app providing a clean interface for browsing, reading and downloading eBooks using an existing Calibre database. This software is a fork of library and licensed under the GPL v3 License.

HTML Scraper

  •    Java

The HTML Scraper is a utility written in Java which acts as a 'screen scraper' for HTML pages.

web-scraper-chrome-extension - Web data extraction tool implemented as chrome extension

  •    Javascript

Web Scraper is a chrome browser extension built for data extraction from web pages. Using this extension you can create a plan (sitemap) how a web site should be traversed and what should be extracted. Using these sitemaps the Web Scraper will navigate the site accordingly and extract all data. Scraped data later can be exported as CSV. When submitting a bug please attach an exported sitemap if possible.

facebook-page-post-scraper - Data scraper for Facebook Pages, and also code accompanying the blog post How to Scrape Data From Facebook Page Posts for Statistical Analysis

  •    Python

UPDATE December 2017: Due to a bug on Facebook's end, using this scraper will only return a very small subset of posts (5-10% of posts) over a limited timeframe. Since Facebook now owns CrowdTangle, the (paid) canonical source of historical Facebook data, Facebook doesn't have an incentive to fix the linked bug. On December 12th, a Facebook engineer commented that they are developing a new endpoint for scraping posts chronologically. I will refactor this script once that happens. Until then, there likely will not be any PRs accepted.

scraper - A scraper for EmulationStation written in Go using hashing

  •    Go

An auto-scraper for EmulationStation written in Go using hashes. This currently works with NES, SNES, N64, GB, GBC, GBA, MD, SMS, 32X, GG, PCE, A2600, LNX, MAME/FBA(see below), Dreamcast(bin/gdi), PSX(bin/cue), ScummVM, SegaCD, WonderSwan, WonderSwan Color ROMs. The script works by crawling a directory of ROM files looking for known extensions. When it finds a file it hashes the ROM data minus any headers or special file formatting with the goal of hashing only the data pulled from the original game. It compares this hash to a DB I've compiled to look up the correct game in theGamesDB.net. It downloads the metadata and builds the gamelist.xml file.

scraperjs - A complete and versatile web scraper.

  •    Javascript

Scraperjs is a web scraper module that make scraping the web an easy job. Try to spot the differences.

colly - Elegant Scraper and Crawler Framework for Golang

  •    Go

Colly provides a clean interface to write any kind of crawler/scraper/spider. With Colly you can easily extract structured data from websites, which can be used for a wide range of applications, like data mining, data processing or archiving.






We have large collection of open source products. Follow the tags from Tag Cloud >>


Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.