CRANV2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - g7 - 4. 100T Index Language I.I. a (::{. -[. ?<:Aura', b[OCRerr]nt:u:[OCRerr]ge. F, xhaustivity of Indexin[OCRerr] 3 Search Rule A Document Relevance i - 4 Number of Doeumen![OCRerr] in Col]ec*[OCRerr]on I, ,100 Number of Questions 221 ([OCRerr]u[OCRerr]se/ 3) Nunlber of Relevant D:gcun[OCRerr]cnts I, 500 GeneralJ.ty Nuntber 5. i Co~rdlnation) Coord- i [OCRerr]ccal] Precision Fallout Ination Ratio Ratio Ratio x y z Level a/a+c a/a+b b/b+d 1 i Documeni[OCRerr] Relrieved Rel. Non- re], 1.510 !Su, 122 95.0% 0.9% 51. 596% 221 221 221 2 1,283 58,122 80.7% 2.2% 4.1':[OCRerr], 18. 883% 221 221 221 3 9,1G 21, :[OCRerr].3 59.5% 7. 125"," 215 220 220 4 606 7, ,[OCRerr]5[OCRerr] 38.1% 7.5[OCRerr]o 2. 390% 187 212 212 5 314 2, 3[OCRerr]0 19.7% 11. 5% 0. 773[OCRerr] 131 197 197 6 154 {[OCRerr]99 9.7% 18. 0% 0. 227% 8fi 164 164 7 74 2i6 4,7% 25.5% 0.070% 50 140 140 3 22 43 1.47[OCRerr] 33.8% 0.014% 18 105 105 8 5 o.5% 61.5% o.oo2% 8 78 78 13 1 0 o.1% lOO. O% 0.000% 1 52 52 II 0 0 0 32 32 12 0 0 0 15 15 13 0 0 0 8 8 14 0 0 0 4 4 15 0 0 i 0 3 3 [OCRerr]IGURE 4. 101T Index Language L 2. a (S. T. Synonyms. Exhaustlvity of Indexing 3 Search Rule A Document Relevance 1 - 4 Number of Documents in Collection 1,400 Number of Questions 221 (Subset 3) Number of Relevant Documents 1,590 Generality Number 5. I Coordlnatlon) Coord- Documents Recall Precision Fallout ination Retrieved Ratio Ratio Ratio x y z LĒvel Re]. Non-rel. a/a+c a/a+b b/b+d 1 1.514 (-) 05.2% (-) (-) 221 0 221 2 1.313 59 734, 82.6% 2.2%* 19.406"/#[OCRerr] 221 44* 221 3 981 23,554[OCRerr] 61.7% 4.0%* 7. 680%* 218 109" 220 644 [OCRerr],350" 40.5% 6.8%* 2. 873%* 192 142" 212 5 355 2,94G* 22.3% 10.4'{o* 0.957%* 139 177" 197 g 169 92[OCRerr]* i0.6% 15.4%* 0. 301%* 92 161" 154 7 80 254 5.0% 24.0% o. 083% 55 140 140 8 24 59 1.5% 2a, 9% 0. o19% 23 105 105 9 8 8 0.5% 50.0% 0.003% 8 78 78 IO 1 0 0.1% 100.0% 0.000% 1 52 52 11 0 0 0 32 32 12 0 0 0 15 15 13 0 0 0 8 8 14 0 0 0 4 4 15 0 0 0 3 3 !i; 'i,i