May not be of much use if they're ignoring robots.txt, but I just tripped across the following fascinating resource that's attempting to provide "A List of Known AI Agents on the Internet" https://darkvisitors.com/ Paul R. Pival Research Librarian – Qualitative Data Analysis Economics Liaison Librarian University of Calgary TFDL 460C ppival_at_ucalgary.ca Pronouns: he, him, hisReceived on Thu Apr 11 2024 - 12:09:05 EDT