# www.robotstxt.org/ # http://code.google.com/web/controlcrawlindex/ Sitemap: https://www.lovesales.com/sitemap.xml Sitemap: https://www.lovesales.com/blog/post-sitemap.xml # --- AI training crawlers: blocked (no traffic in return) --- User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bytespider User-agent: Meta-ExternalAgent User-agent: Amazonbot User-agent: cohere-ai User-agent: Diffbot User-agent: omgili User-agent: Timpibot Disallow: / # --- Everyone else, including Google, Bing and AI search bots --- User-agent: * Disallow: /?* Disallow: /add-by-email Disallow: /add-to-my-list Disallow: /buy-now Disallow: /change-password Disallow: /facebook Disallow: /forgot-password Disallow: /home/?* Disallow: /home/get-content Disallow: /latest-sale/get-content Disallow: /latest-sales/?* Disallow: /latest-sales/get-content Disallow: /login Disallow: /my-brands Disallow: /my-list Disallow: /not-found Disallow: /not-signed-up Disallow: /privacy-policy Disallow: /sales-feed/*?* Disallow: /sales-feed/get-content Disallow: /sign-up Disallow: /terms-of-service Disallow: /zz-*