About
Meta's web crawler used for link previews, content indexing, and AI training. Fetches pages shared on Facebook, Instagram, and WhatsApp to generate previews and feed Meta's AI models.
Purpose
Link previews and AI model training
User Agent String
Mozilla/5.0 (compatible; FacebookBot/1.0; +https://www.facebook.com/externalhit_uatext.php)
How to Control in robots.txt
🚫 Block FacebookBot
User-agent: FacebookBot Disallow: /
✅ Allow FacebookBot
User-agent: FacebookBot Allow: /
Other Bots by Meta
Is FacebookBot crawling your site?
Run a free scan to check if Meta's crawler is accessing your website.
Check if FacebookBot is crawling YOUR site →