CRANV2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 122 FIGURE 4.400T Index Language I. I. a (S. T. Natural language. Coordination) Exhaustivity of Indexing 2 Search R[OCRerr]le A Document Relevance i - 4 Number of Documents in Collection 1,400 Number of Questions 221 (Subaet 3) Number of Relevant Documents 1,590 Generality Number 5.1 Coord- Documents Recall Precision Fallout ination Retrieved Ratio Ratio Ratio Level Re1. Nou-rel. a/a+c a/a+b x y z b]b+d I 1,480 (-) g3.1% (-) (-) 2 1.227 49,372* 221 0 221 3 880 18,764" 77.2% 2.4%* 55.7% 16.040%* 4.5%* 221 44* 221 6. 092%* 210 109" 220 4 552 6,813. 5 279 34.7% 2.301" 7.5%* 17.5% 2.212%* 177 142" 212 6 131 514" 10.8%* 8.2% 20.3%* 0.747%* 121 177" 187 0,167%* 76 161" 164 7 58 133 8 18 3.6% 30.4% 41 140 140 o. 5% 39. I'% 0.043% 9 28 1.1% 8 0 0.009% l oo. 0% 14 105 o. 000% 105 6 78 78 I0 1 11 0 O.l% 0 lOO.O% 0.000% 1 52 52 12 0 0 0 0 32 32 0 15 15 13 14 0 0 0 8 8 15 0 0 0 0 0 4 4 0 3 3 FIGURE 4.401T -Index Language l.l.a (S.T. Natural language. Exhaustivity of Indexing 1 Search Rttle A Document Relevance i - 4 Number of Documents in Collection 1,400 Number of Questions 221 (Subset 3) Number of Relevant Documents i, 590 Generality Number 5.1 Coo rdmat ion) Coord- Documents Recall Precision Fallout Ination Retrieved Ratio Ratio Ratio y z Level Re1. Non-tel. a / a+c a] a+b b/b+d I 1.373 (-) 66.4% (-) (-) 221 0 221 2 1,055 23,164" 3 86.4% 4.4%* 655 7,823* 7.525%* 41.2% 7.7%* 2.540%* 22i 44* 221 199 109" 220 4 331 2,169" 5 20.8% 13.2%* 148 477* 0.704%* 154 142" 212 6 9.3% 67 134' 23.7%* 0.155[OCRerr] 88 177" 197 4.2% 33.2%* 0.043%* 49 161. 164 7 29 36 8 1.8% 7 43.3% 0.012% 25 140 140 9 0 O. 4% 2 43.8% 0. 003% 105 105 0 o.1% 9 loo. o% 0,000% 2 78 78 I0 0 0 II 0 0 0 52 52 12 0 0 0 32 32 O 15 15 13 0 0 14 0 0 6 8 15 0 0 0 0 4 4 0 3 3