AI SEO Glossary

PerplexityBot is the web crawler operated by Perplexity AI to index web content for use in its real-time search and answer generation. Because Perplexity is built around live web retrieval rather than pre-trained static knowledge, its crawler is particularly active and consequential for visibility in Perplexity’s platform. PerplexityBot identifies itself in server logs and respects robots.txt rules. Unlike some AI crawlers that blend training and retrieval purposes, PerplexityBot is primarily focused on retrieval, making it directly connected to what sources appear in Perplexity’s generated answers.

Allowing or blocking PerplexityBot uses the same robots.txt mechanism as other crawlers, with a User-agent: PerplexityBot directive. Because Perplexity relies on live web retrieval for virtually all of its answers, blocking PerplexityBot has a more direct and immediate effect on your Perplexity visibility than blocking some other AI crawlers whose impact is more indirect through training. If Perplexity is a traffic source you want to develop, allowing PerplexityBot across your main content areas while potentially restricting it from sensitive internal pages is the standard approach.

Why it matters: Perplexity citations drive measurable referral traffic because the platform passes referral data. Blocking PerplexityBot directly eliminates your eligibility for that traffic source.