#Filter web-robot crawling # Ignore FrontPage files User-agent: * Disallow: /_Old Disallow: /Data Disallow: /Errors Disallow: /Formatting Disallow: /images Disallow: /Includes Disallow: /xml Disallow: /help Disallow: /textonly