CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 117 - [OCRerr]= IGURE 4. 330T Index Language 1. ld (S.T. Exhaustivity of Indexing 3 Search Rate B Document Relevance 1 - 4 Number of Documents in Collection Number of Queations 19 (Subset 4) N[OCRerr]rvbcr of Relevant Documents 131 GeneraLity Number 4.9 Natural language, Coordination, Partitioning. Interllxlng) 1.400 Coord- Doca[OCRerr]aerrts tnation Recall Retrieved Precision Fallout l.. Level Rel. Non-rel. Ratio a/a+c Ratio a/a+b Ratio bJb+d x y z I 1 113 ee (-) 2 (-) 56.3% (-) (_) 19 0 19 3 50 6v. 2% (.) 223* (-) 38.2% 18.3a[OCRerr][OCRerr]' 19 o. 642"j[OCRerr] 0 19 19 7* 19 4 16 36 5 7 12.2% 30.5% 5.3% 0.13e% 1O 19 19 6 0 4 0 I00.0% 3.1% 0.00O% 100,0% 3 19 0.00O% 19 1 7 19 19 3 8 0 2.3% 100.0% 0.000% 1 19 10 9 10 11 12 13 14 15 FIGURE 4.33 t T Index Language I. ld Exhauativity of Indexing 3 Search Rule B Document Relevance 1 - 4 Number of Documents in Collection 1,400 Number of Questions 17 (Subset 5) Number of Relevant Documents 109 Generality Number 4.6 (S.T. Natural language. Coordination. Partitioning, Interfixing) Coord- Documents ination Recall Retrieved Precision Fallout Level Ratio Rel. Non-rel. a/a+c Ratio a/a+b Ratio b/b+d x y z I 2 108 (-) 96 (-) 00.1% (-) (.) 17 0 17 3 86.1% (-) (_) 76 (-) 17 5[OCRerr].7% 0 (-) 17 (_) 17 0 17 4 53 5 (-) 32 49.6% (-) (_) 17 0 17 6 217 16 29.4% 12.9% 74 14.7% 0.916% 17.8% 14 17 0.312% 17 I0 17 17 7 8 8 0 7.3% 100. o% 4.6% o. 000% 5 17 17 0 5 0 0 1oo.o% 0 0.000% 3 17 17 0 17 17 I0 0 II 0 0 0 17 17 12 0 0 17 17 13 14 15