# Limit access frequency by specifying crawl delay User-agent: Bingbot Crawl-delay: 30 User-Agent: * Disallow: /admin/ Disallow: /password/ Disallow: /confirmation/ Disallow: /mediainfo/documents