CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 138 - FIGURE 4. 513T Index Language I. 6. a (S, T. Synonyms, Quasi-synonyms, Word forms. Coordination Exhaustivity of Indexing 3 Search Hale C Document Relevance 1 - 4 Number of Documents in Collection 1,400 Number of Questinns 20 (Subset 6) Number of Relevant Documents see table Generality Number see table Coord- Documents ination Relevant Generality Retrieved Recall Precision Fallout Level Document s Number Rel. Non-rel. Ratio Ratio Ratio x y z 1 147 5,3 140 (-) 2 147 95.2% (-) (.) 20 5.3 113 0 3,323* 20 3 119 76.9% 3.3[OCRerr]* 20 13" 5.0 ii.93o[OCRerr] 66 1,544 57.1% 20 4.2% 6.519% 17 17 17 4 94 4.8 38 299 40.4% 11.3% II 14 5 14 43 1.533% 4.4 12 33 6 21 27.9% 26.7% 7 5.0 2 0.338% 6 7 2 9.5% 50.0% 0.046% I 3 3 FIGURE 4: 514T Index Language I.l.a (S.T. Natural language. Coordination) Exhaostivity of Indexing 3 Search Rule D Document Relevance 1 - 4 Number of Documents in Collection1,400 Number of Questions 29 (Subset 6) Number of Relevant Documents see table Generality Number see table Coord- Document s ination Relevant Generality Retrieved Recall Precision Fallout Level Documents Number Ret. Non-rel. R at io R at io R at io x y z 1 147 5.3 97 2 2,213 66.0% 147 4.5% 20 20 5.3 7.945% 20 73 653 3 119 49.7% 10.1% 20 20 5.0 42 163 35.3% 20.5% 2.344% 20 0.688% 15 17 17 4 94 4.8 20 14 5 21.3% 43 58.8% 8 4.4 14 14 7 4 16.3% 0.072% 6 21 63.6% 2 7 5.0 7 1 2 0.041% 4.8% 33.3% 0.048% I 3 3 FIGURE 4. 515T Index Language 1.6.a (SmT. Synonyms, Quasi-synonyms, Word forms. Exhaustivity of Indexing 3 Search Rule D Document Relevance 1 - 4 Number of Documents in Collection 1,400 Number of Questions 20 (Subset 6} Number of Relevant Documents see table Coordination} Coord- ination Relevant Generality Documents Recall Precision Fallout x y z Level Documents Number Retrieved Hel, Non-rel. Ratio Ratio Ratio 1 147 5.3 102 2 147 2,668 69.4% 3.7% 20 5.3 20 20 81 791 9.579% 3 119 55.1% 9.3% 5.0 48 20 189 2.840% 20 20 40.3% 20.3% 0. 798% 15 17 17 4 94 4.8 25 5 21 43 4.4 26.6% 54.3% 11 10 14 14 6 23.3% O. 108% 6 21 62.5% 5.0 0. 061% 4 7 7 1 2 4.8% 33.3% 0. 048% 1 3 3