User-agent: * Allow: / # Note: AI usage preferences are expressed below via per-bot User-agent # directives — the standard mechanism. The Cloudflare-proposed # Content-Signal extension was removed because strict parsers (e.g. Semrush) # flag it as malformed, and the explicit per-bot Allow blocks below already # grant the same access. # ── Tier 1: AI Search Crawlers (CRITICAL) ────────────────── User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / # ── Tier 2: Broader AI Ecosystem ─────────────────────────── User-agent: Google-Extended Allow: / User-agent: GoogleOther Allow: / User-agent: Applebot-Extended Allow: / User-agent: Amazonbot Allow: / User-agent: FacebookBot Allow: / # ── Tier 3: Training (allowed) ───────────────────────────── User-agent: anthropic-ai Allow: / User-agent: cohere-ai Allow: / # ── Blocked: Aggressive / Low Value ──────────────────────── User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / Sitemap: https://kinvophone.com/sitemap.xml