TREC-4: Comments
- Difficulties comparing results across sites (uncontrolled variables)
- Requirement to use all 25 topics a problem given the desire to get as many query-system combinations as possible
- Task did not relate well to some topics which suggest one relevant document would be enough
- Assessor-searcher differences in judging relevance cloud system differences