How to Block AI Bots on Joomla

User-agent: GPTBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: Google-Extended
Disallow: /

Method 1: Edit robots.txt (Fastest)

Joomla stores a static robots.txt file in the site root — the same directory as index.php and configuration.php. Edit it directly with FTP/SFTP, SSH, or your hosting control panel's file manager. No extensions or admin-panel changes required.

1. 1

   Connect to your server via FTP/SFTP or open your hosting control panel file manager.

2. 2

   Navigate to the Joomla root and open robots.txt for editing (typically /public_html/robots.txt on shared hosting, or /var/www/html/robots.txt on VPS).

3. 3

   Replace or append with the full AI bot block list:

User-agent: *
Allow: /

User-agent: GPTBot
Disallow: /

User-agent: ChatGPT-User
Disallow: /

User-agent: OAI-SearchBot
Disallow: /

User-agent: ClaudeBot
Disallow: /

User-agent: anthropic-ai
Disallow: /

User-agent: Google-Extended
Disallow: /

User-agent: Bytespider
Disallow: /

User-agent: CCBot
Disallow: /

User-agent: PerplexityBot
Disallow: /

User-agent: meta-externalagent
Disallow: /

User-agent: Amazonbot
Disallow: /

User-agent: Applebot-Extended
Disallow: /

User-agent: xAI-Bot
Disallow: /

User-agent: DeepSeekBot
Disallow: /

User-agent: MistralBot
Disallow: /

User-agent: Diffbot
Disallow: /

User-agent: cohere-ai
Disallow: /

User-agent: AI2Bot
Disallow: /

User-agent: DuckAssistBot
Disallow: /

User-agent: omgilibot
Disallow: /

User-agent: webzio-extended
Disallow: /

User-agent: gemini-deep-research
Disallow: /

Sitemap: https://yourdomain.com/sitemap.xml

4. 4

   Replace yourdomain.com in the Sitemap line with your domain. Save and upload. Verify at https://yourdomain.com/robots.txt.

Method 2: noai Meta Tag via Template (All Joomla Installs)

The noai meta tag adds a second layer of protection — it signals AI bots at the page level. The most reliable way to add it to every Joomla page is editing your active template's index.php file.

Option A: Template Editor in Joomla Admin (Joomla 4.x)

1. 1

   Log into Joomla Admin. Go to System → Site Templates.

2. 2

   Click the name of your active template (marked with a star). Then click Open Template Editor.

3. 3

   In the file tree on the left, click index.php.

4. 4

   Find the </head> closing tag. Add the noai tag immediately before it:

   <meta name="robots" content="noai, noimageai">
   </head>

5. 5

   Click Save. No cache clearing needed for template file changes.

Option B: Extensions → Templates (Joomla 3.x)

1. 1

   Go to Extensions → Templates → Templates. Click your active template (star icon). Click the Editor tab.

2. 2

   Click index.php in the file list. Find </head> and add the meta tag before it (same as above). Save.

Method 3: .htaccess Server Blocking (Apache)

Joomla runs on Apache and ships with its own .htaccess file (or htaccess.txt that you rename to .htaccess). Adding RewriteCond rules blocks AI bots at the web server level — before Joomla or PHP processes the request. This is more robust than robots.txt for bots that ignore it (like Bytespider).

Open your Joomla .htaccess in the site root. Add this block at the very top, before any existing content:

# Block AI training crawlers — add BEFORE Joomla's RewriteEngine block
<IfModule mod_rewrite.c>
RewriteEngine On
RewriteCond %{HTTP_USER_AGENT} (GPTBot|ChatGPT-User|OAI-SearchBot) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (ClaudeBot|anthropic-ai) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (Google-Extended|Bytespider) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (CCBot|PerplexityBot) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (meta-externalagent|Amazonbot) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (Applebot-Extended|xAI-Bot) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (DeepSeekBot|MistralBot) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (Diffbot|cohere-ai) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (AI2Bot|DuckAssistBot) [NC,OR]
RewriteCond %{HTTP_USER_AGENT} (omgilibot|webzio-extended|gemini-deep-research) [NC]
RewriteRule ^ - [F,L]
</IfModule>

if ($http_user_agent ~* "(GPTBot|ClaudeBot|CCBot|Google-Extended|Bytespider|PerplexityBot|anthropic-ai|meta-externalagent|Amazonbot|xAI-Bot|DeepSeekBot|MistralBot|Diffbot|cohere-ai|AI2Bot|DuckAssistBot|omgilibot|webzio-extended|gemini-deep-research)") {
    return 403;
}

Method 4: Cloudflare WAF (All Hosting)

Works with any Joomla hosting — shared, VPS, managed. Blocks AI bots at Cloudflare's edge before they reach your server. The most effective method against bots that ignore robots.txt directives.

1. 1Add your domain to Cloudflare (free plan) and update your DNS nameservers.
2. 2In your Cloudflare dashboard → Security → WAF → Custom Rules → Create rule.
3. 3Click Edit expression and paste:

(http.user_agent contains "GPTBot") or
(http.user_agent contains "ClaudeBot") or
(http.user_agent contains "anthropic-ai") or
(http.user_agent contains "Google-Extended") or
(http.user_agent contains "Bytespider") or
(http.user_agent contains "CCBot") or
(http.user_agent contains "PerplexityBot") or
(http.user_agent contains "meta-externalagent") or
(http.user_agent contains "DeepSeekBot") or
(http.user_agent contains "MistralBot") or
(http.user_agent contains "xAI-Bot") or
(http.user_agent contains "Diffbot") or
(http.user_agent contains "cohere-ai") or
(http.user_agent contains "AI2Bot") or
(http.user_agent contains "DuckAssistBot") or
(http.user_agent contains "omgilibot") or
(http.user_agent contains "webzio-extended") or
(http.user_agent contains "gemini-deep-research")

Set action to Block. Joomla never processes the request.

All 25 AI Bots to Block

User agents for the robots.txt rules, .htaccess, and Cloudflare WAF:

Will This Affect Joomla SEO?

# Default Joomla! robots.txt (blocks nothing useful for AI)
User-agent: *
Disallow: /administrator/
Disallow: /cache/
Disallow: /cli/
Disallow: /components/
Disallow: /includes/
Disallow: /libraries/
# ... etc.
# NO AI bot rules — all public content accessible

Frequently Asked Questions