Qrels used in Experiment 1
Can define 348 different TREC-style qrels
- Used 100,000 randomly selected sample
- Plus 3 distinguished qrels (Original, A, B)
-
Used 2 combination qrels
- Intersection (doc is relevant if all say relevant)
- Union (doc is relevant if any say relevant)