# robots, scram # Allows only major search engines and known friendly spiders # Major Search Engines and Known Friendly Spiders (allowed) User-agent: archive.org_bot Disallow: /apps/ User-agent: Googlebot Disallow: /apps/ User-agent: MSNBot Disallow: /apps/ User-agent: Slurp Disallow: /apps/ User-agent: Teoma Disallow: /apps/ User-agent: Twiceler Disallow: /apps/ User-agent: Gigabot Disallow: /apps/ User-agent: Scrubby Disallow: /apps/ User-agent: Robozilla Disallow: /apps/ # Everyone Else (NOT allowed) User-agent: * Disallow: /