Dealing with bot traffic - what tools/services are you using?

From: Lucky, Shannon <shannon.lucky_at_nyob>
Date: Thu, 30 Apr 2026 18:35:58 +0000
To: CODE4LIB_at_LISTS.CLIR.ORG
Hi all,

I am curious what methods folks are using to deal with aggressive AI harvesting on websites - particularly digital project sites. Many of our servers are being hammered with traffic that impacts our service delivery and the methods we have been using cannot keep up.

Specifically I am wondering who is using services like Cloudflare or implementing OS solutions like Anubis, or are you using something else? I'm gathering information about what services or methods are being using at academic libraries hosting DH/digital projects so we can look at investing in some kind of service or process solution.

What are you using? Are you happy with it? What kinds of costs are associated?)


Shannon Lucky, MLIS MA

she/her

Associate Librarian


University of Saskatchewan

University Library

Ph: 306-966-2740

ORCID 0000-0001-9134-8560<https://orcid.org/0000-0001-9134-8560>


I acknowledge that I live and work on Treaty 6 Territory and the Homeland of the Métis. We pay our respect to the First Nations and Métis ancestors of this place and reaffirm our relationship with one another.
Received on Thu Apr 30 2026 - 14:36:01 EDT