CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. [OCRerr] 93 - FIGURE 4. 120T C˘ rd- ir[OCRerr] ion L ;el Index Language L I. a (S. T. Natural language. Coordination) Exhaustivity of Indexing 3 Search Rde A Document Relevance 1 - 4 Number of Documents in CoLlection Number of Questions 42 (Subset 2) Number of Relevant Documents 198 Generality Numo˘.r 3.4 -----.---____._._ Documents Heeall Retrieved Ratio Rel 189 162 132 68 49 25 12 4 0 0 0 0 Noa-rel. a/a-re 34, 127 95.5% 9, 811 81.6% 3,979 66.7% 1. 029 44.4% 251 24.7% 56 12.6% n 6.1% 1 2.0% 1 0.0% 0 0 0 1.400 Precision Fallout Ratio Ratio a/a+b b]b+d 0. 6% 57. 068% 1.6% 16. 406% 3.2% 6. 790% 7.8% 1. 772% 16, 3% 0,428% 30.9% o. 096% 52.2% O. 019% 80.0% O. 002% o. 0% o. 002% 8 9 10 11 12 13 14 15 x y z 42 42 42 42 42 42 42 42 42 30 41 41 25 39 39 16 33 33 8 27 27 2 18 16 1 11 11 O 7 7 0 3 3 0 1 1 FIGUBE 4. 121T Index Language 1. 2. a (S. T. Synonyms. Exhaustivity of Indexing 3 Search Rule A Doeumenl Relevance 1 - 4 Number of Documents in Collection 1.400 Number of Questions 42 (Subset 2) Number of Relevant Documents 198 Generality Number 3.4 Ination Level 1 2 3 4 5 6 I 7 8 9 I0 11 12 13 14 15 Documents Retrieved Rel. Non-rel. 189 (-) 165 I0,47[OCRerr] 134 4,614 90 1,244 55 320 25 67 12 15 4 1 0 1 0 0 0 0 0 0 Coordination) RecaLl Precision FaLlout Ratio Ratio Ratio a/a+c a/a+b b/b+d 95.5% (-) (_) 83.370 1.6%* 17.510%, 67. 770 2.8% 7.873% 45.5% 6.7% 2.123% 27.8% 14,7% 0.546% 12.6% 27.2% 0.114% 6.1% 44.4% 0.026% 2.07, 8o. 0% o. 002% o. 0% o. 0% o. 002% x y z 42 0 42 42 6* 42 42 42 42 38 41 41 27 39 39 16 33 33 10 27 27 2 18 18 1 11 11 0 7 7 0 3 3 0 1 l