About
Perplexity AI's crawler that powers their AI search engine. Fetches web pages in real-time to provide sourced, up-to-date answers to user queries.
Purpose
AI search engine indexing and real-time retrieval
User Agent String
Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; PerplexityBot/1.0; +https://perplexity.ai/perplexitybot)
How to Control in robots.txt
🚫 Block PerplexityBot
User-agent: PerplexityBot Disallow: /
✅ Allow PerplexityBot
User-agent: PerplexityBot Allow: /
Complete Guide: How to Block PerplexityBot
Server-level blocking, nginx configs, Cloudflare rules, Next.js middleware, and more →
Is PerplexityBot crawling your site?
Run a free scan to check if Perplexity AI's crawler is accessing your website.
Check if PerplexityBot is crawling YOUR site →