I have completed a beta version of the RobotsEditor plugin (I was previously calling it the RobotsTxt plugin).
The plugin provides a simple interface for creating the equivalent of robots.txt files in Manila. The plugin installs a custom responder that returns a text string. The default text string allows all robots to visit all pages in the subdomain (this is equivalent to having no robots.txt file). Alternatively, you can use the plugin to edit the robots.txt file to limit robot access to portions (or all) of your site. The responder looks for and returns these site specific robots.txt files.
The plugin is currently only available for testing by ES Designs hosting clients. However, if you are interested in testing the plugin, let me know and I can set up a test site for you.
11:44:07 PM
|