Displaying 1 to 12 from 12 results

sitemap.js - Sitemap-generating framework for node.js

  •    Javascript

sitemap.js is a high-level sitemap-generating framework that makes creating sitemap XML files easy.Description specifications. Required fields are thumbnail_loc, title, and description.

hexo-generator-sitemap - Sitemap generator for Hexo.

  •    Javascript

Generate sitemap.You can configure this plugin in _config.yml.

sitemap-static - Make a sitemap for a static website based on files on disk

  •    Javascript

Use in the root directory of the files on the site. This will only add files with .html extensions to the sitemap.

jstoxml - JavaScript object to XML converter

  •    Javascript

Everyone loves JSON, and more and more folks want to move that direction, but we still need things outputted in XML! Particularly for RSS feeds and Podcasts. This is inspired by node-jsontoxml, which was found to be a bit too rough around the edges. jstoxml attempts to fix that by being more flexible.




algolia-sitemap - a node library allowing you to generate sitemaps from an Algolia index.

  •    Javascript

This is a node library allowing you to generate sitemaps from an Algolia index. Requires node v6+ (make an issue if this is a problem for you).

sitemap-webpack-plugin - Webpack plugin to generate a sitemap.

  •    Javascript

Webpack plugin to generate a sitemap. Designed to work with static-site-generator-webpack-plugin (although it also works great by itself). For webpack 4, use version 0.6 or greater. For webpack <= 3, use version 0.5.x.

slinky - web crawler just for links

  •    Javascript

Slinky is a web crawler, but just for the links between webpages. Slinky is intended to be used to visualize the routes and structure behind a website by collecting hyperlinks. If you decide to print out the source code and drop it down a flight of stairs, you may not be disappointed either.

express-sitemap-xml - Serve sitemap.xml from a list of URLs in Express

  •    Javascript

Create an Express middleware that serves sitemap.xml from a list of URLs. This package automatically handles sitemaps with more than 50,000 URLs. In these cases, multiple sitemap files will be generated along with a "sitemap index" to comply with the sitemap spec and requirements from search engines like Google.


domain_hunter - A Burp Suite Extender that search sub domain and similar domain from sitemap,get related domains from certification

  •    Java

A Burp Suite extender that search sub domains,similar domains and related domains from sitemap. Some times similar domain and related domains give you surprise^_^. that's why I care about it. 2017-07-28: Add a function to crawl all known subdomains; fix some bug.

supercrawler - A web crawler

  •    Javascript

Supercrawler is a Node.js web crawler. It is designed to be highly configurable and easy to use. When Supercrawler successfully crawls a page (which could be an image, a text document or any other file), it will fire your custom content-type handlers. Define your own custom handlers to parse pages, save data and do anything else you need.

robotparser-scala - robotparser-scala implements a parser for the robots.txt file format in Scala.

  •    Scala

robotparser-scala implements a parser for the robots.txt file format in Scala. And then, you have RobotsTxt instance. By default, character encoding is UTF-8.





We have large collection of open source products. Follow the tags from Tag Cloud >>


Open source products are scattered around the web. Please provide information about the open source projects you own / you use. Add Projects.