URL checking for the catalog

There's been some recent discussion at our site about revi(s|v)ing URL checking in our catalog, and I was wondering if other sites have any strategies that they have found to be effective.

We used to run some home-grown link checking software. It fit nicely into a shell pipeline, so it was easy to filter out sites that didn't want to be link checked. But still the reports had too many spurious errors. And with over a million links in the catalog, there are some issues of scale, both for checking the links and consuming any report.

Anyhow, if you have some system you use as part of catalog link maintenance, or if there's some link checking software that you've had good experiences with, or if there's some related experience you'd like to share, I'd like to hear about it.

Thanks,

-Tod


Tod Olson <tod_at_uchicago.edu>
Systems Librarian     
University of Chicago Library