# *.scrubsmax.com robots.txt – Crawl it, Max it. User-agent: * Allow: / Crawl-delay: 10 # Rover get back! User-agent: Roverbot Disallow: / Sitemap: https://www.scrubsmax.com/xmlsitemap.php