Sitemap: https://www.edsurge.com/sitemap.xml User-agent: * Allow: / User-agent: ia_archiver Allow: / User-agent: bingbot Crawl-delay: 16 User-agent: msnbot Crawl-delay: 16 User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: MJ12bot Disallow: / User-agent: +centuryb.o.t9[at]gmail.com Disallow: /