Cloudflare has released a new free tool to prevent AI companies’ bots from scraping its clients’ websites for content to train large language models. The tool will be available to all customers, including those on free plans, and will be updated over time to block offending bots. According to Cloudflare’s data, 85.2% of customers have chosen to block even AI bots that properly identify themselves. The most active bots identified by Cloudflare include Bytespider and OpenAI’s GPTBot. It is challenging to fully block AI bots from accessing content, with some companies skirting or breaking rules around blocking scrapers. Cloudflare is taking steps to address this issue and plans to continue evolving its machine learning models to combat bot behavior. The company aims to create a space where content creators have control over how their content is used for training AI models.
Source link
Source link: https://www.engadget.com/cloudflare-is-taking-a-stand-against-ai-website-scrapers-220030471.html
#Cloudflare stands against AI website scrapers with new initiative.
