About
Brave's independent search crawler powering Brave Search — the only major search engine with a fully independent index (not built on Google or Bing). BraveBot crawls the web without tracking users, reflecting Brave Search's privacy-first philosophy. Growing in importance as privacy-conscious users and AI tools increasingly rely on Brave Search.
Purpose
Independent search indexing for Brave Search
User Agent String
Mozilla/5.0 (Linux x86_64; compatible; BraveBot/1.0; +https://search.brave.com/crawler)
How to Control in robots.txt
🚫 Block BraveBot
User-agent: BraveBot Disallow: /
✅ Allow BraveBot
User-agent: BraveBot Allow: /
Is BraveBot crawling your site?
Run a free scan to check if Brave's crawler is accessing your website.
Check if BraveBot is crawling YOUR site →