User-agent: 008 Disallow: / User-agent: MJ12bot Disallow: / User-agent: Baiduspiders Disallow: / User-agent: NerdyBot Disallow: / User-agent: WBSearchBot Disallow: / User-agent: * Crawl-delay: 20 Allow: / User-agent: Googlebot Disallow: User-agent: AdsBot-Google Disallow: User-agent: Googlebot-Image Disallow: