# AI Shadowing — robots.txt # 允许所有搜索引擎和 AI 爬虫索引(包括 GPTBot / ClaudeBot / PerplexityBot 等) User-agent: * Allow: / # 显式允许主流 AI 爬虫 User-agent: GPTBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: CCBot Allow: / # 不索引 Firebase 内部路径(如有) Disallow: /__/ Sitemap: https://aishadowing.net/sitemap.xml