IRS13 Test Environment chapter E. M. Keen Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. 1-10 RELEVANCE DECISIONS Scale of five relevance grades, done by request preparers (subject experts), based mainly on full documents, by examination of entire collection. Dichotomous, done by request preparers (staff members), based on abstracts, by examination of entire collection. Dichotomous, done by request preparers (non-staff members), based on abstracts (IRE-3) and full text (ADI), by ex- amination of entire collection. IRE-3 CRAN-l ADI [OCRerr]42) \;17) [OCRerr]l7) ¼(35) Techniques Used for Obtaining Relevance Decisions Fig. 5