User-agent: * Allow: / Disallow: /api/ # AI assistants and their crawlers may read the public pages (never the /api/ search data). User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: CCBot User-agent: Amazonbot User-agent: Bytespider User-agent: Applebot-Extended User-agent: meta-externalagent User-agent: Google-Extended Allow: / Disallow: /api/ # SEO-data resellers: no access. User-agent: AhrefsBot User-agent: BLEXBot User-agent: DataForSeoBot User-agent: DotBot User-agent: MJ12bot User-agent: SemrushBot Disallow: / Sitemap: https://www.eridura.com/sitemap.xml