Experimentation within TREC
Aims to develop and evaluate new approaches to IR
Uses traditional test collection approach:
- Shared tasks
- Shared test collections (large)
- Shared evaluation metrics
Supports comparison of systems and system components:
- Which perform significantly better?
- Why do they perform better?