User-agent: Mediapartners-Google Disallow: User-agent: bingbot Crawl-Delay: 30 User-agent: msnbot Crawl-Delay: 30 User-agent: Baiduspider Crawl-Delay: 30 User-agent: Baiduspider+ Crawl-Delay: 30 User-agent: Yandex Crawl-Delay: 30