Displaying 1 to 9 from 9 results

Norconex HTTP Collector - Enterprise Web Crawler

  •    Java

Norconex HTTP Collector is a full-featured web crawler (or spider) that can manipulate and store collected data into a repositoriy of your choice (e.g. a search engine). It very flexible, powerful, easy to extend, and portable.

web-data-extractor - Extracting and parsing structured data with jQuery Selector, XPath or JsonPath from common web format like HTML, XML and JSON

  •    Java

Web Data Extractor - Extracting and parsing structured data with Jquery Selector, XPath or JsonPath from common web format like HTML, XML and JSON.




domain_hunter - A Burp Suite Extender that search sub domain and similar domain from sitemap,get related domains from certification

  •    Java

A Burp Suite extender that search sub domains,similar domains and related domains from sitemap. Some times similar domain and related domains give you surprise^_^. that's why I care about it. 2017-07-28: Add a function to crawl all known subdomains; fix some bug.