User-agent: * # directed to all spiders, not just Scooter Disallow: /cgi-local/ Disallow: /download/ Disallow: /assets/ Disallow: /stage/ Disallow: /nladmin/ Disallow: /private/ Disallow: /admin/ Disallow: /dbase/ Disallow: /report/