# https://toppalt.r01.no/robots.txt User-agent: * Allow: / Disallow: /healthz Disallow: /readyz Disallow: /admin Disallow: /kiosk Disallow: /api Disallow: /dev-access Disallow: /sign-in # Opt out of AI training (search + user fetches stay allowed): # User-agent: GPTBot # User-agent: ClaudeBot # User-agent: Google-Extended # User-agent: Applebot-Extended # User-agent: CCBot # User-agent: meta-externalagent # Disallow: / Sitemap: https://toppalt.r01.no/sitemap.xml