Limits on Realism
- Fixed searcher task - very generic so as to be acceptable to the widest range of researchers
- Fixed topics, collection - content not specifically of interest to many searchers; not suitable for specialized searching
- Fixed judgements by NIST assessors
- changing search goals and concept of relevance
- assessors� backgrounds very different from typical experimental searchers�