Prospects Inside TREC
- Sharing task, collection, topics, and evaluation scheme is the norm in TREC - a basis for comparison of systems is desirable
- Tracks could in theory share less and still be part of TREC
- What subsets make sense in terms of saving labor, maximizing the common basis for discussion and supporting cross-site comparison?
- NIST welcomes track proposals that identify useful subsets and address the tradeoffs involved