Cloudflare announced plans on Monday to launch a marketplace in the next year where website owners can sell AI model providers access to scrape their site’s content. The marketplace is the final step of Cloudflare CEO Matthew Prince’s larger plan to give publishers greater control over how and when AI bots scrape their websites. AI-powered search startup Perplexity was accused of scraping websites that deliberately indicated they did not want to be crawled using the Robots Exclusion Protocol. Shortly after, Cloudflare released a button to ensure customers could block all AI bots with one click. While AI companies may not initially be excited about paying for content they currently get for free, Cloudflare’s CEO says he thinks this is ultimately good for the AI ecosystem. Should data scraping be illegal ?
Previous Article
Qualcomm’s potential Intel buyoutNext Article
Launch of Google TV Streamer