Search Engine Journal
Follow
Cloudflare Lets Sites Disallow AI Training Without Blocking Googlebot
Cloudflare's Disallow AI Training keeps mixed-use crawlers available for search. Google and Apple honor training opt-outs; Bing robots.txt support is pending.