About
DuckDuckGo's primary web crawler that builds the search index powering DuckDuckGo Search and its AI assistant DuckAssist. Unlike most search engines, DuckDuckGo explicitly commits to not tracking users. DuckAssist, their AI answer feature, draws on content indexed by this crawler to generate direct answers with cited sources. Note: DuckAssistBot is a separate bot used specifically for real-time AI answer retrieval.
Purpose
Search indexing and DuckAssist AI answer support
User Agent String
DuckDuckBot/1.0; (+http://duckduckgo.com/duckduckbot.html)
How to Control in robots.txt
🚫 Block DuckDuckBot
User-agent: DuckDuckBot Disallow: /
✅ Allow DuckDuckBot
User-agent: DuckDuckBot Allow: /
Other Bots by DuckDuckGo
Is DuckDuckBot crawling your site?
Run a free scan to check if DuckDuckGo's crawler is accessing your website.
Check if DuckDuckBot is crawling YOUR site →