PerplexityBot

PerplexityBot is Perplexity’s crawler, designed to surface and link websites in Perplexity’s search results. According to Perplexity’s documentation, it is not used to crawl content for AI foundation models. A separate fetcher, Perplexity-User, handles requests triggered by a user’s question.

PerplexityBot in Practice

Perplexity’s documentation says Perplexity-User generally ignores robots.txt rules because a person initiated the fetch ([Perplexity](https://docs.perplexity.ai/docs/resources/perplexity-crawlers.md)). In August 2025, Cloudflare reported that Perplexity used undeclared crawlers to reach pages that had blocked its declared bot, and removed it from its verified-bots list; Perplexity disputed this, arguing that user-driven agents only fetch what a user’s request needs ([MediaNama](https://www.medianama.com/2025/08/223-ai-crawlers-user-driven-tools-malicious-bots-perplexity-cloudflare/)). Perplexity has since said PerplexityBot crawls in compliance with robots.txt, and that it won’t index the text of pages that block it ([GazeRank](https://www.gazerank.com/learn/news/perplexitybot-crawl-update)).


How PerplexityBot Activity Is Tracked

Filter logs for PerplexityBot and Perplexity-User as separate agents, and verify against the IP ranges Perplexity publishes. Because of the dispute above, robots.txt alone is an incomplete control — sites that need firm blocking typically enforce it at the firewall as well.


Why PerplexityBot Matters

Allowing PerplexityBot is a search-visibility decision, not a training decision, since Perplexity says it doesn’t use this bot for model training. Blocking it makes your pages ineligible to be surfaced and cited in Perplexity results, which in turn removes a source of AI referral traffic.


Terms Related to PerplexityBot

GPTBot ·
ClaudeBot ·
AI Referral Traffic
robots.txt for AI Crawlers


FAQ

Is PerplexityBot a training crawler?
Per Perplexity’s own documentation, no — it exists to surface and link sites in search results. Independent parties have disputed some of Perplexity’s crawling behavior, so verification through logs is worth doing.