# tivio.ai — crawling policy # # Search crawlers: everything is open except the CMS admin UI. # AI answer engines are allowed on purpose: a growing share of research into # "KI für Kommunen" happens inside assistants rather than on a SERP, and being # quotable there is worth more than withholding the content. User-agent: * Disallow: /admin Disallow: /demo-abgelaufen Disallow: /brief Disallow: /q/ # --- AI crawlers / answer engines (explicitly allowed) --- User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / Sitemap: https://tivio.ai/sitemap.xml