How crawlers impact the operations of the Wikimedia projectsby Wikimedia Foundation on diff.wikimedia.orgrobots.txt aiRobots all the way downNoted April 7, 2025
Mid March infra bits 2025by Kevin on www.scrye.comai robots.txtExample of AI not honoring robots.txtNoted March 30, 2025
