Robots.txt

A handy tool to track spider visits and create Robots.txt instructions

Choose a server below to download:

Robots.txt

Server 1 - Software Author: Download

Robots.txt Review

Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions

Recommended

• Terrasoft CRM CRM software for mid-size business.
• Registry First Aid A clean registry speeds up your computer!
• Spyware Doctor Advanced spyware, adware and malware remover

Related Software

• site optimization
• log file analysis
• spider visits
• robots.txt editor
• spider instructions
• search engine indexation
• search engine optimization