# ArithLab robots.txt User-agent: * Allow: / Disallow: /dashboard Disallow: /api/ Disallow: /login Disallow: /register # Explicitly allow AI crawlers for AI search visibility User-agent: GPTBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Googlebot Allow: / Sitemap: https://www.arithlab.ai/sitemap.xml