https://openshadow.io 2026-04-04T09:18:12.532Z weekly 1 https://openshadow.io/check 2026-04-04T09:18:12.532Z weekly 0.9 https://openshadow.io/bots 2026-04-04T09:18:12.532Z weekly 0.8 https://openshadow.io/docs 2026-04-04T09:18:12.532Z monthly 0.6 https://openshadow.io/tools 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/tools/robots-txt 2026-04-04T09:18:12.532Z monthly 0.8 https://openshadow.io/tools/robots-checker 2026-04-04T09:18:12.532Z monthly 0.8 https://openshadow.io/tools/meta-tags 2026-04-04T09:18:12.532Z monthly 0.8 https://openshadow.io/tools/llms-txt 2026-04-04T09:18:12.532Z monthly 0.8 https://openshadow.io/tools/ai-visibility 2026-04-04T09:18:12.532Z monthly 0.8 https://openshadow.io/scans 2026-04-04T09:18:12.532Z daily 0.5 https://openshadow.io/guides 2026-04-04T09:18:12.532Z weekly 0.7 https://openshadow.io/agent-analytics 2026-04-04T09:18:12.532Z monthly 0.5 https://openshadow.io/guides/ai-content-protection-tools 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/ai-readiness-score 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/ai-search-ranking 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-ai-agents 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-ai2bot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-amazonbot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-applebot-extended 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-bingbot-copilot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-bytespider 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-ccbot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-chatgpt-user 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-claudebot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-cohere-ai 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-deepseekbot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-diffbot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-duckassistbot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-gemini-deep-research 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-google-extended 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-google-notebooklm 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-gptbot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-meta-externalagent 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-mistralbot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-oai-searchbot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-perplexitybot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-webzio-omgili 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-xai-bot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/blocking-youbot 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/llms-txt 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/monitor-ai-bot-traffic 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/noai-meta-tag 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/robots-txt-ai-bots 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/guides/tdmrep-ai-training 2026-04-04T09:18:12.532Z monthly 0.9 https://openshadow.io/bots/gptbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/chatgpt-user 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/oai-searchbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/claudebot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/perplexitybot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/google-extended 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/gemini 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/bytespider 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/ccbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/amazonbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/applebot-extended 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/facebookbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/meta-externalagent 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/cohere-ai 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/youbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/diffbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/petalbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/barkrowler 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/timpibot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/seekr 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/kangaroo-bot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/velenpublicwebcrawler 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/omgili 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/icc-crawler 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/brightbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/scrapy 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/xai-bot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/duckassistbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/bingbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/ai2bot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/mistralbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/googlebot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/applebot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/ahrefsbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/semrushbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/yandexbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/baiduspider 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/bravebot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/naverbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/huggingfacebot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/duckduckbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/linkedinbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/archive-org-bot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/turnitinbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/iaskspider 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/sogou 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/dataforseobot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/mj12bot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/rogerbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/deepseekbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/firecrawl 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/jinabot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/exabot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/mojeekbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/apifybot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/qwenbot 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/yandexgpt 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/img2dataset 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/news-please 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/slurp 2026-04-04T09:18:12.532Z monthly 0.7 https://openshadow.io/bots/twitterbot 2026-04-04T09:18:12.532Z monthly 0.7