# robots.txt for dunningly.me # AI search crawlers - these decide whether Dunningly can appear in AI answers. User-agent: OAI-SearchBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: PerplexityBot Allow: / # User-triggered fetchers: they follow a live user request, not an index crawl. # OpenAI states ChatGPT-User is not used to determine whether content may # appear in Search. Perplexity-User generally ignores robots.txt (user-triggered). User-agent: ChatGPT-User Allow: / User-agent: Claude-User Allow: / # Training-only bots (GPTBot, ClaudeBot) are a separate policy decision - # blocking them does NOT remove you from AI search results.