About
Cohere's web crawler for training their enterprise AI models. Cohere focuses on business-oriented AI and uses crawled data to train language models for enterprise search and generation.
Purpose
Enterprise AI model training
User Agent String
cohere-ai
How to Control in robots.txt
🚫 Block cohere-ai
User-agent: cohere-ai Disallow: /
✅ Allow cohere-ai
User-agent: cohere-ai Allow: /
Complete Guide: How to Block cohere-ai
Server-level blocking, nginx configs, Cloudflare rules, Next.js middleware, and more →
Is cohere-ai crawling your site?
Enter your URL below — scan takes under 5 seconds.
Free · No signup · Instant results