Anubis Deploys Proof-of-Work to Combat Aggressive AI Scrapers
TL;DR. Anubis, a web protection system, has implemented a Proof-of-Work scheme to deter aggressive AI companies from scraping websites. - The system increases the load on mass scrapers, making data extraction more expensive and less efficient. - Anubis is a temporary measure while developers focus on fingerprinting headless browsers for better identification. - Users must enable JavaScript to pass the Anubis challenge; a no-JS solution is under development.
- Anubis uses a Proof-of-Work scheme to create a computational cost for AI scrapers.
- The system aims to prevent website downtime caused by aggressive scraping activities.
- A future solution will focus on advanced headless browser fingerprinting to reduce user friction.
Sources
- AI and the Courts – A Cautionary Tale — bailii.org