NRobots.txt

  •        0

The Robots Exclusion Protocol or robots.txt protocol, is a convention to prevent cooperating web spiders and other web robots from accessing all or part of a website which is otherwise publicly viewable.

http://nrobots.codeplex.com/

Tags
Implementation
License
Platform

   




Related Projects