gargantua - The fast website crawler

  •        1

from your command line on Linux, macOS and Windows. Note: Press Q to stop the current crawling process.

https://github.com/andreaskoch/gargantua

Tags
Implementation
License
Platform

   




Related Projects

Mvc Xml Sitemap

  •    

MVC Sitemap makes it a snap for your ASP.NET MVC based web site to expose a sitemap xml file to search engine crawlers. Simply place a [Sitemap] attribute on all Actions you want crawled and create an action for the sitemap - it's that easy.

sitemap.js - Sitemap-generating framework for node.js

  •    Javascript

sitemap.js is a high-level sitemap-generating framework that makes creating sitemap XML files easy.Description specifications. Required fields are thumbnail_loc, title, and description.

yq - Command-line YAML and XML processor - jq wrapper for YAML/XML documents

  •    Python

Before using yq, you also have to install its dependency, jq. See the jq installation instructions for details and directions specific to your platform. Use the --width/-w argument to pass the line wrap width for string literals. All other command line arguments are forwarded to jq. yq forwards the exit code jq produced, unless there was an error in YAML parsing, in which case the exit code is 1. See the jq manual for more details on jq features and options.

WiX Toolset - Windows Installer XML

  •    CSharp

The Windows Installer XML (WiX) is a toolset that builds Windows installation packages from XML source code. The toolset supports a command line environment that developers may integrate into their build processes to build MSI and MSM setup packages.

sitemap-php - Library for generating Google sitemap XML files

  •    PHP

For the 90's people, i'm keeping this repository as 5.2 compatible. If you need PSR-0 and Composer compatible version, here is a fork that maintained by Evert Pot. Include Sitemap.php file to your PHP document and call Sitemap class with your base domain.


Sitemaps.NET

  •    ASPNET

Sitemaps.NET is a website plugin that automatically generates an XML sitemap of your content. Sitemaps.NET reuses ASP.NET's sitemap functionality and automatically mirrors changes in your site to search engines. Features include: - Quickly generate XML sitemaps for search eng...

SiteMap Editor for Microsoft Dynamics CRM 2011

  •    

SiteMap Editor for Microsoft Dynamics CRM 2011 helps developer and customizers to configure the Site Map in a graphical way. You'll no longer have to create solution, add component, export, update Xml and reimport the solution to update the SiteMap.

fast-xml-parser - Validate XML, Parse XML to JS/JSON and vise versa, or parse XML to Nimn rapidly without C/C++ based libraries and no callback

  •    Javascript

This project welcomes contributors. If you have a feature you'd like to see implemented or a bug you'd liked fixed, the best and fastest way to make that happen is to implement it and submit a PR. Basic knowledge of JS is sufficient. Feel free to ask for any guidance. To use it from CLI Install it globally with -g option.

XMLStarlet command line XML toolkit

  •    C

XMLStarlet is a set of command line utilities (tools) to transform, query, validate, and edit XML documents and files using simple set of shell commands in similar way it is done for text files with UNIX grep, sed, awk, diff, patch, join, etc utilities.

XML Utility for DNN Blog Module

  •    

This is a mini-project which allows you to easily add or generate an XML site map to your DotNetNuke® website for the search engines to use to index your blog. You can also generate and use custom Atom RSS feeds for your blog.

laravel-sitemap - Create and generate sitemaps with ease

  •    PHP

This package can generate a sitemap without you having to add urls to it manually. This works by crawling your entire site. The generator has the ability to execute JavaScript on each page so links injected into the dom by JavaScript will be crawled as well.

xsh - an XML Editing Shell

  •    Perl

XSH is a powerfull command-line XML editing tool/programming language in the manner of Unix shell interpreters and line-oriented text editors like ed which can be used either interactively or for batch-mode XML processing.

Valkyrie

  •    C++

Valkyrie is an open-source graphical user interface for the Valgrind 3.3.X line. Valkyrie uses the Qt widget library, and is based on Valgrind`s XML output capabilities. Valkyrie is designed for simplicity and ease of use, whilst allowing access to the full range of Valgrind command-line options.

ASP.NET Essentials Components

  •    

Toolkit for ASP.NET 3.5 WebForms projects. Main features: 1) Modular architecture. Every module is declated in external XML file 2) URL rewriting 3) Set of high level business line server controls 4) Dynamic pages 5) Custom sitemap definition

Xml search and replace

  •    CSharp

XmlSearchReplace is a free commandline utility to replace text inside an xml document. It gives the user control over where in the xml document the search should be done. The tool allows users to search and replace texts only inside xml element/attribute name and/or value.

Apache Xalan for Java XSLT Processor - Xalan-J is an XSLT processor written in Java.

  •    Java

Xalan-J is an XSLT processor written in Java.

Open Search Server

  •    C++

Open Search Server is both a modern crawler and search engine and a suite of high-powered full text search algorithms. Built using the best open source technologies like lucene, zkoss, tomcat, poi, tagsoup. Open Search Server is a stable, high-performance piece of software.

Xml Typed Serializer Generator - XGenPlus

  •    DotNet

Xml Typed Serializer Generator (XGenPlus) is a flexible Xml Typed Serializer Generator. It is very flexible to use. Last Modified - Nov 07, 2007 - Sivakumar Gopalakrishnan, Anoop Madhusudanan -- - - -> Provides a set of command line options for createing typed serializer l...

Ruby Unit Test Tool

  •    Ruby

A command line unit test tool loads up text or xml input and generates result report. Can be used on command line program testings.