# SwishSpider for internal search access User-agent: SwishSpider Disallow: # Allow Google to crawl us User-agent: Googlebot Disallow: /*.gif$ Disallow: /*.jpg$ Disallow: /restricted/ # Everyone else User-agent: * Disallow: /