AI SEO Glossary

GPTBot is the web crawler operated by OpenAI that visits websites to collect content used in training future versions of its language models and powering real-time retrieval in ChatGPT Search. It identifies itself in server logs with the user agent string GPTBot and respects robots.txt directives. OpenAI began disclosing GPTBot publicly in 2023. Webmasters can allow full access, block it entirely, or restrict it to specific sections of the site using robots.txt rules. Blocking GPTBot may limit your content’s influence on ChatGPT’s outputs and reduce your chances of being cited in ChatGPT Search responses.

Whether to block GPTBot depends on your business goals and risk tolerance. Blocking GPTBot prevents OpenAI from using your content in training future models and reduces the chance of your content being retrieved in ChatGPT Search responses. Some publishers and media organizations have blocked it to protect their content from being used without compensation. For most brands focused on maximizing AI visibility, allowing GPTBot is the better choice since it keeps your content in the pool that ChatGPT’s retrieval system draws from. A middle-ground option is allowing retrieval access while blocking training access, though OpenAI’s implementation of these distinctions has evolved over time.

Why it matters: If ChatGPT Search is a channel your audience uses and you have blocked GPTBot, you have opted yourself out of that visibility without necessarily realizing it.