User-agent: * Crawl-delay: 2 Disallow: /admin Disallow: /account/ Disallow: /cart/ Disallow: /compare/ Disallow: /checkout/ User-agent: RavenCrawler Crawl-delay: 0 Disallow: /account/ Disallow: /cart/ Disallow: /compare/ Disallow: /checkout/ Disallow: /product/configure/ Disallow: /product/variants Sitemap: https://www.fitnesskoerier.nl/sitemap.xml