IRS13 Test Environment chapter E. M. Keen Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. 1-22 Dictionary Total [OCRerr] Relevant Non-Relevant Recall: Precision Retrieved Retrieved Retrieved Suffix s' [OCRerr]3 22 21 .111 .515 Stem 54 27 27 .136 .500 Thesaurus-3 227 67 160 .338 .295 Cut-off determined by Cosine Numeric Correlation > 0.35 .[OCRerr] Micro-evaluation with total relevant 198 Cran-l collection, abstracts, averages over 42 requests Evaluation using Correlation Cut-off Showing Recall Device Effect of the Dictionaries Fig. 8