# Robots text- instructions for search engines # If new directory is added that you do not want to be added by any search engine put it in the User-agent * column like the others (print, worddocs etc). # To specifiy an individual direcotry start new User-agent. User-agent is robot name. Get lists from Internet. User-agent: * Disallow: /print Disallow: /templates Disallow: /worddocs Disallow: /temp.html Disallow: /gopher Disallow: /error.html # Ben Sutcliffe, walking-line.co.uk. # Use hash for comments.