How to algorithmicaly evaluate a ranking function ?

Hi all,


I want to evaluate the ranking of my discovery system to tune the ranking function. are there datasets or benchmarks I can use?


i.e. a list of queries and the ranked results?


I want to evaluate different functions and weights  for this an automated repeatable approach that does not require  user tests  for every run would be nice


Thanks for your help


Jannis