CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 90- FIGURE 4. IIOT Index Language L I° a (S. T. Natural language. E[OCRerr]d[OCRerr]ustlvity of indexing 3 Search Rule A Document Relevance 1 - 4 Number of Documents in Collection 1,400 Number of Questions 35 (Subset 1) Number of Relevant Documents 287 Generality Number 5.9 Coordination) Cooz'd- Documents Recall Precision Fallout inatioa Retrieved Ratlo Ratio Ratio x y = Level Rel, Non-rel. a/a+c aJa+b b/b+d i 268 23,681 93.4% I. 1% 49. 329% 35 35 35 2 221 9, 096 77.0% 2.7% 16. 500% 35 35 35 3 157 2.805 54,7% 5.2% 5.e5i% 34 35 35 4 94 600 32.8% 13.5% 1. 232% 29 35 35 5 45 147 16.4% 23. [OCRerr] 0.291% 19 35 35 6 22 37 7.7% 37.2% 0. 076% 7 35 35 7 9 8 2.8% 50.0% 0. 016% 3 35 35 FIGURE 4. lItT Index Language L 2. a (S. T. Synonyms. Exhaustlvity of Indexing 3 Search Rule A Document Relevance I - 4 Number of Documents in Collection 1.400 Number of Questions 35 (Subset I) Number of Relevant Documents 287 Generality Number 5.9 Coordination) Coord- Documente RecaLl Precision FaLlout Ir[OCRerr]tiou Retrieved Ratio Ratio Ratio x y Level Rel. Non-tel.. ala+e a/a+b b/b+d l 269 (-) 93.9% (-) (-) 35 0 35 2 226 8, 514. 78.8% 2.0%, 17.357[OCRerr]u, 35 23* 35 3 164 3.026 5=7.2% 5.I% e.z12% 34 35 35 4 99 650 34.5% 13.2% 1. 334% 28 35 35 5 51 151 17.8% 25.2% 0.310% 19 35 35 6 23 39 6.0% 37.1% 0,080% 8 35 35 7 8 8 2.8% 50.0% O. 016% 3 35 35 FIGURE 4. l12T Index Language L 3. a (S. T. Word forms. Coordination) . Exhaustivity of Indexing 3 [OCRerr]earch Rule A Document Relevance 1 - 4 Number of Documents in Collection 1,400 Number of Queutions 35 (Subset 1) Number of Relevant Documents 287 Generality Number 5.9 Coord- Documents Recall Precision Fallout Ination Retrieved Ratio Ratio Ratio x y = Level Rel. Non-rel. a/a+c a/a+b b/b+d 1 270 (-) 94.1% (-) (-) 35 0 35 2 227 9, 174' 79.1% 2.4%[OCRerr] 19.[OCRerr] 51U%* 35 23* 35 ' 3 173 3,408 59,3% 4.7% 6.996% 35 35 35 4 t03 768 35.9% 11.8% 1.577% 30 35 35 5 55 184 19.2% 23.0% 0,375% 21 35 35 6 25 44 8.8%. 36.2% 0,090% 12 35 35 .... 7 5 9 ...... [OCRerr]:_8[OCRerr] ......... 5_o..o%. ....... 3.°[OCRerr]e% .........[OCRerr] .... _3s_._[OCRerr]s__