Conclusion
Benchmark tasks can be a powerful way to advance the state-of-the art
The Cranfield paradigm provides a time-tested methodology for building retrieval test collections
Some MIR/MDL tasks seem amenable to such evaluation
Previous slide
Back to first slide
View graphic version