Cloudflare launches tool to help website owners monetise AI bot crawler access

Cloudflare has launched a tool that blocks bot crawlers from accessing content without permission or compensation to help websites make money from AI firms trying to access and train on their content, the software company said on Tuesday.

The tool allows website owners to choose whether artificial intelligence crawlers can access their material and set a price for access through a “pay per crawl” model, which will help them control how their work is used and compensated, Cloudflare said.

With AI crawlers increasingly collecting content without…