Robots

Cookbook /
: BlockCrawler Redirect web crawlers to different pages
: ControllingWebRobots How to control web robots or bots trying to scan files (stable)
: GoogleSitemaps How to submit a complete list of web pages to google
PmWiki /
: Robots Setting available to control robots

Edit - History - Print - Recent Changes - Search

Page last modified on September 10, 2011, at 12:46 PM