About
Exa.ai (formerly Metaphor) is a neural search engine built for AI applications. ExaBot crawls the web to power Exa's semantic search API, which is used by thousands of AI agents and LLM-powered products to fetch relevant, up-to-date web content.
Purpose
Neural search indexing for AI applications
User Agent String
Mozilla/5.0 (compatible; Exa-Search/1.0; +https://exa.ai)
How to Control in robots.txt
🚫 Block ExaBot
User-agent: ExaBot Disallow: /
✅ Allow ExaBot
User-agent: ExaBot Allow: /
Is ExaBot crawling your site?
Run a free scan to check if Exa AI's crawler is accessing your website.
Check if ExaBot is crawling YOUR site →