#For more information on how robots.txt files work #see http://www.searchengineworld.com/robots/robots_tutorial.htm User-agent: * Disallow: /private/ Disallow: extras.php Disallow: extras_content.php Disallow: /extras/