Are Test Collections Useful?
Yes!
- 30+ years of experience has shown that retrieval techniques developed on test collections work in other environments, including operational settings
- Earlier studies of small collections suggest comparative evaluation insensitive to precise set of relevant documents