Search Engine Journal
Follow
OpenAI Says Robots.txt May Not Apply To ChatGPT’s Fetch Bot
New data shows ChatGPT's page-fetching bot is reaching sites that have disallowed it, and OpenAI's own documentation explains why the file may not stop it.
