IRS13 Scientific Report No. IRS-13 Information Storage and Retrieval Thesaurus, Phrase and Hierarchy Dictionaries chapter E. M. Keen Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. VII-20 Evaluation Number and Percentage* Input and Measure Used of Individual Requests To Determine Thesaurus Stem Both Collection Thesaurus Type Merit Superior Superior Equal IRE-3 Abstract Normed. Recall 28 82.4% 6 17.6% 0 34 Requests (Thesaurus-3) Normed. Precision 26 76.5% 8 23.5% 0 Abstract Normed. Recall 24 61.5% 15 48.5% 3 CRAN-l (Thesaurus-3) Normed. Precision 22 56.4% 17 43.6% 3 42 Indexing Normed. Recall 21 53.8% 18 46.2% 3 Requests (Thesaurus-2) Normed. Precision 25 64.1% 14 35.9% 3 Text Normed. Recall 22 64.7% 12 35.3% 1 ADI (Thesaurus-i) Normed. Precision 23 67.6% 11 32.4% 1 35 Abstract Normed. Recall 20 62.5% 12 37.5% 3 Requests (Thesaurus-i) Normed. Precision 24 70.6% 10 29.4% 1 *Percentages do not include cases where dictionaries have equal merit Comparisons of Individual Request Merit giving the Number of Requests Favoring Stem and Thesaurus for Five Runs in Three Collections, according to Merit Assigned by[OCRerr]Norma1ized Recall and Precision Fig. 13