Re: Dealing with bot traffic - what tools/services are you using?

From: Marijane White <000001a6145c64e4-dmarc-request_at_nyob>
Date: Thu, 30 Apr 2026 20:33:12 +0000
To: CODE4LIB_at_LISTS.CLIR.ORG
Another plug for the Code4Lib Slack: there is a very active #bots channel where people discuss solutions like CloudFlare Turnstile and Anubis. The creator of Anubis, Xe Iaso, hangs out there!

-Marijane

On 4/30/26, 11:36 AM, "Code for Libraries on behalf of Lucky, Shannon" <CODE4LIB_at_LISTS.CLIR.ORG <mailto:CODE4LIB_at_LISTS.CLIR.ORG> on behalf of shannon.lucky_at_USASK.CA <mailto:shannon.lucky_at_USASK.CA>> wrote:


Hi all,


I am curious what methods folks are using to deal with aggressive AI harvesting on websites - particularly digital project sites. Many of our servers are being hammered with traffic that impacts our service delivery and the methods we have been using cannot keep up.


Specifically I am wondering who is using services like Cloudflare or implementing OS solutions like Anubis, or are you using something else? I'm gathering information about what services or methods are being using at academic libraries hosting DH/digital projects so we can look at investing in some kind of service or process solution.


What are you using? Are you happy with it? What kinds of costs are associated?)




Shannon Lucky, MLIS MA


she/her


Associate Librarian




University of Saskatchewan


University Library


Ph: 306-966-2740


ORCID 0000-0001-9134-8560<https://urldefense.com/v3/__https://orcid.org/0000-0001-9134-8560__;!!Mi0JBg!MdReAgHFR2hyecXiekUfeLiHv40A1MOLw_f_uDT_WniFycZddsscle5eBE8iRYseWFM_Lr1Hxk-v1IY9Bw5JieM$ <https://urldefense.com/v3/__https://orcid.org/0000-0001-9134-8560__;!!Mi0JBg!MdReAgHFR2hyecXiekUfeLiHv40A1MOLw_f_uDT_WniFycZddsscle5eBE8iRYseWFM_Lr1Hxk-v1IY9Bw5JieM$> >




I acknowledge that I live and work on Treaty 6 Territory and the Homeland of the Métis. We pay our respect to the First Nations and Métis ancestors of this place and reaffirm our relationship with one another.



Received on Thu Apr 30 2026 - 16:33:16 EDT