# robots.txt # ---------- # Summary : This robots.txt file welcomes all robots to all # parts of the web except the confidential tree. # Date : 10-Dec-1996. # Author : Ross N. Williams (ross@ross.net). # Standard : http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: * Disallow: /confidential/