Why Is Relative Effectiveness Stable?
Effectiveness is computed as an average over many topics
- Rankings highly correlated when only 25 topics in evaluation set
-
Most topics have a core set of relevant documents
- Assessors agree on core set
- Retrieval systems rank documents in core set before more marginal documents