Cloudflare Helps Website Owners Block AI Scraping Without Losing Search Visibility

Connectivity cloud company Cloudflare has launched a setting that enables website owners to remain visible in search results while blocking crawlers from using their content for artificial intelligence training, the company said in a Tuesday (Sept. Cloudflare’s new Disallow AI Training setting is designed to solve a problem presented by today’s mixed-use crawlers, which collect content for both a search index and AI training. Until now, website owners who blocked these crawle