State of AI
Scraping the Web? Beware the Maze: Cloudflare’s AI Labyrinth traps scrapers with decoy pages
Bots that scrape websites for AI training data often ignore do-not-crawl requests. Now web publishers can enforce such appeals by luring scrapers to AI-generated decoy pages.