# All robots will spider the domain User-agent: * Disallow: /assets/ Disallow: /book/Special:Search Disallow: /book/Special:Random Disallow: /framework/ Disallow: /images/ Disallow: /manager/ Disallow: /temp/