LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem
In mid-March 2025, KDE's GitLab infrastructure was reportedly disrupted by aggressive AI web scrapers originating from Alibaba IP ranges. These bots allegedly ignored robots.txt and spoofed browser headers, which in turn purportedly overwhelmed the site and caused outages for developers. Similar incidents reportedly affected other FOSS projects like GNOME, SourceHut, and Fedora. The scraping is allegedly tied to large language model training, and reportedly imposes real costs and delays.
- Date it happened
- 2025-03-17
- Organisation involved
- Alibaba, Generative AI developers
- Product, system or model
- Websites hosting FOSS documentation or bug trackers, SourceHut infrastructure, Pagure.io (Fedora), KDE, GNOME, GitLab instances, Anubis proof-of-work systems, AI scrapers
This incident was imported from AI Incident Database and is used under CC BY-SA 4.0. Our additions to it — the structured fields, the translation, the checks against other reports — are published under the same licence.
This is a record of what was reported, not a finding that anyone broke the law. If it names your organisation and you believe it is wrong, the corrections process is free and open to everyone.