DocumentaciónHelp

Block AI crawlers

Stop bots that train or feed artificial intelligence models from reading your help center, without removing it from Google or Bing.

On this page

By default, any bot can read your help center, just like any person. If you do not want your documentation used to train or feed artificial intelligence models, you can block those bots.

Before you start

  • You need the administrator level in Settings (Administrator role).

  • The help center must be activated. Read Activate the help center.

Steps

  1. Go to Settings → Help center, on the Site tab.

  2. In the AI crawlers card, select Block.

You see the AI crawlers blocked message. The change is saved instantly.

To allow them again, clear Block. You see AI crawlers allowed.

What it does

With Block selected:

  • the site's rules file for bots (robots.txt) asks AI bots not to come in;

  • and, since not all of them respect that rule, the site also answers them "forbidden" when they try.

Under the switch, the card shows the list of blocked bots, with their technical name. Among them are those from OpenAI (GPTBot, ChatGPT-User), Anthropic (ClaudeBot), Common Crawl (CCBot), Google's AI use (Google-Extended), Perplexity (PerplexityBot), ByteDance (Bytespider), Amazon (Amazonbot), Apple for AI (Applebot-Extended) and Meta (meta-externalagent).

What does not change

  • Regular search engines keep indexing your help center. Google and Bing use bots that are different from the AI ones, so your pages keep appearing in their results.

  • People keep reading the site as always, without signing in.

  • The Elion assistant is not affected: inside the platform it reads Knowledge pages directly, not the public site.

Blocking works with bots that identify themselves by name. A bot that pretends to be a regular browser cannot be told apart from a person. If no one outside your company should read a page, do not put it in a Public space.

Related

Search Elion ITSM

Type at least 2 characters to search Elion ITSM.

↑↓ to navigate · Enter to open · Esc to close