# Default: allow search engines and everyone else User-agent: * Allow: / # AI search crawlers (allowed) User-agent: OAI-SearchBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: PerplexityBot Allow: / # AI training crawlers (blocked) User-agent: GPTBot Disallow: / User-agent: ClaudeBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: Applebot-Extended Disallow: / # Sitemap Sitemap: https://global100.forttuna.com/robots.txt