Implications for Music IR?
Task definition is the dominating factor in the success of an evaluation
- constrains data required
- constrains type/amount of judgments
- determines what can be learned
- therefore, subject to much debate ?
Task = What functionality is to be tested?