CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 190 - FIGURE 4.910T Index Language 1.3.a (Single terms. Word forms. Exhaustivity of Indexing 2 Search Rule A Document Relevance 1 - 4 Number of Documents in Collection 200 (Subset 1) Number of Questions 42 (Subset 2) Number of Relevant Documents 198 Generality Number 23.6 Coordination Coord- Documents Recall Precision Fallout ination Retrieved Ratio Ratio Ratio x y z Level Rel. Non-tel. a/a+c a/a+b b/b+d 1 188 4,037 94.9% 4.4% 49.220% 42 42 2 162 1,867 81.8% 8.0% 22.763% 42 42 42 42 3 128 694 64.6% 15,6% 8.461% 40 42 42 4 87 208 43.9% 29.5% 2.536% 32 41 41 5 47 66 23.7% 41.6% 0.805% 22 39 39 6 30 17 15.2% 63.8% 0.207% 13 33 33 7 11 2 5.6% 94.6% 0,024% 5 27 27 8 3 0 1.5% lOO.O% 0.000% 2 18 18 9 0 0 0 11 11 10 0 0 0 7 7 11 0 0 0 3 3 12 0 0 0 1 1 FIGURE 4.911T Index Language 1.3.a (Single terms. Word forms. Exhaustivity of Indexing 1 Search Rule A Document Relevance 1 - 4 Number of Documents in Collection 200 (Subset 1) Number of Questions 42 (Subset 2) Number of Relevant Documents 198 Generality Number 23.6 Coordination) Coord- Documents Recall Precision Fa[OCRerr]out ination Retrieved Ratio Ratio Ratio x y z Level Bel. Non-rel. a/a+c a/a+b b/b+d 1 177 2,626 89.4% 32.017% 42 42 42 2 138 1,101 69.7% 6.3% 11.1% 13.424% 42 42 42 3 103 308 52.0% 25.1% 3.755% 36 42 42 4 6O 8O 30.3% 42.9% 28 41 5 3O 0,975% 41 23 15.2% 56.6% 0.280% 14 39 6 17 39 3 8.6% 85,0% 0,037% 9 33 33 7 7 0 3.5% 1oo.o% 0.000% 3 27 8 1 27 0 o. 5% IOO. 0% o, 000% 1 18 ii 18 9 0 0 0 II lO 0 0 0 7 7 11 0 0 0 3 3 12 0 0 0 1 1