# Social link-preview bots — explicit Allow blocks for paths that the # wildcard User-agent disallows. Listed first so the named bots match # their own block instead of falling through to "*". User-agent: LinkedInBot Allow: /certificate-share/ User-agent: Twitterbot Allow: /certificate-share/ User-agent: facebookexternalhit Allow: /certificate-share/ User-agent: WhatsApp Allow: /certificate-share/ User-agent: TelegramBot Allow: /certificate-share/ User-agent: * Allow: / Disallow: /sponsoring/test.html Disallow: /certificate-validate/ Disallow: /certificate-share/ # AI / LLM crawlers — policy: allow User-agent: GPTBot Allow: / Disallow: /sponsoring/test.html Disallow: /certificate-validate/ Disallow: /certificate-share/ User-agent: ClaudeBot Allow: / Disallow: /sponsoring/test.html Disallow: /certificate-validate/ Disallow: /certificate-share/ User-agent: PerplexityBot Allow: / Disallow: /sponsoring/test.html Disallow: /certificate-validate/ Disallow: /certificate-share/ User-agent: Google-Extended Allow: / Disallow: /sponsoring/test.html Disallow: /certificate-validate/ Disallow: /certificate-share/ User-agent: CCBot Allow: / Disallow: /sponsoring/test.html Disallow: /certificate-validate/ Disallow: /certificate-share/ Sitemap: https://2027.pycon.de/sitemap.xml