# Kalos Golf — proposed robots.txt # Pattern: Travelopia house style (three-tier AI policy, as on enchantingtravels.com) # Deploy via Yoast's file editor (live file is currently the Yoast virtual default). # ── Traditional search engines ───────────────────────────────── User-agent: Googlebot User-agent: Bingbot Allow: / Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /?s= # Lead form: also add meta-robots noindex on the page (robots.txt alone doesn't de-index) Disallow: /request-a-brochure/ # ── AI Retrieval Bots (ALLOW) ────────────────────────────────── # Power live citations in ChatGPT, Perplexity, Claude, Copilot etc. User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: AzureAI-SearchBot User-agent: DuckAssistBot Allow: / Disallow: /wp-admin/ Disallow: /?s= Disallow: /request-a-brochure/ # ── AI Training Bots (ALLOW) ─────────────────────────────────── # Builds future model knowledge of the brand. User-agent: GPTBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Meta-ExternalAgent User-agent: Applebot-Extended User-agent: Amazonbot Allow: / Disallow: /wp-admin/ Disallow: /?s= Disallow: /request-a-brochure/ # ── Block scrapers with no citation value ────────────────────── User-agent: CCBot User-agent: Diffbot User-agent: Bytespider Disallow: / # ── Default fallback ─────────────────────────────────────────── User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /?s= Disallow: /request-a-brochure/ # ── Sitemap ──────────────────────────────────────────────────── Sitemap: https://www.kalosgolf.com/sitemap_index.xml