Walker, David wrote:
>
> I think you measure it by the number of check-outs and downloads.
>
> Searches, in and of themselves, only tell you that people are "shopping" (to borrow a metaphor from e-commerce). Check-outs and downloads tell you the number of times people are "buying." If our systems are giving our users relevant results, then that _should_ lead to more check outs and downloads.
>
'More' is a relative word. More than... what?
I agree this is a useful general overview metric. I guess it allows you
to compare one version of your software in your patron community to
another version of your software in your same user community... unless
something else changed in the meantime to change the net number of
checkouts/downloads, which you should be cautious of.
But it doesn't let us measure it until it's deployed. It doesn't let us
figure out _what_ needs fixing, what can be improved in a given system,
or how. (Doesn't let us know if users do okay with a known title search,
but miserable with a subject/topic search). It doesn't let us evaluate
potential changes until we deploy them over a large community in
production and measure how it works. Etc. I doubt this metric is
sufficient.
Jonathan
Received on Thu Oct 29 2009 - 12:42:57 EDT