User-agent: * Sitemap: https://www.indudirect.com/sitemap.xml # Filter and sort combinations are not for crawlers; every filtered page is also noindex. Disallow: /shop/catalog-index-all Disallow: /*?*specs= Disallow: /*?*attrib= Disallow: /*?*order= Disallow: /api/ Crawl-delay: 2 # Amazon and price-scraping crawlers: blocked User-agent: Amazonbot User-agent: Amzn-SearchBot User-agent: Amzn-User User-agent: AmazonProductbot User-agent: PriceSpider User-agent: Pricebot User-agent: PriceRunner User-agent: Prisjakt User-agent: PriceGrabber User-agent: Shopwiki User-agent: Mercator User-agent: Shopzilla User-agent: Klarna Disallow: /