# Gradia - robots.txt # https://www.GoGradia.com User-agent: * Allow: / Disallow: /admin Disallow: /admin/* Disallow: /account Disallow: /messages Disallow: /api Disallow: /auth/callback Disallow: /compare Disallow: /wishlist # AI Crawlers - explicitly permitted to index all public content User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Googlebot-Extended Allow: / User-agent: cohere-ai Allow: / User-agent: GeminiBot Allow: / User-agent: YouBot Allow: / # LLM Crawler Manifests # https://www.gogradia.com/llms.txt # https://www.gogradia.com/llms-full.txt # Sitemap Sitemap: https://www.gogradia.com/sitemap-index.xml