IRS13 Thesaurus, Phrase and Hierarchy Dictionaries chapter E. M. Keen Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. Number and Percentage* Evaluation of Individual Requests Collection Request Type Measure used to Determine Thesaurus-3 Hierarchy-3 Both Merit Superior Superior Equal "Parents" 17 Staff-Prepared Normed. Recall 10 58.8% 7 41.2% 0 Requests Normed. Precision 14 82.4% 3 17.6% 0 17 Non-Staff Normed. Recall 7 41.2% 10 58.8% 0 Prepared Requests Normed. Precision 8 47.1% 9 52.9% 0 IRE-3 "All Relations'1 17 Staff-Prepared Normed. Recall 12 70.6% 5 29.4% 0 Requests Normed. Precision 14 82.4% 3 17.6% 0 17 Non-Staff Normed. Recall 8 47.1% 9 52.9% 0 Prepared Requests Normed. Precision 8 50.0% 8 50.0% 1 ;`b- Percentages do not include cases where both dictionaries have equal merit. Comparison of Individual Request Merit Giving the Number of Requests Favoring Thesaurus and Hierarchy Contrasting the Staff and Non-Staff Prepared Requests on IRE, According to Merit Assigned by Normalized Recall and Precision Fig. 30