CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 146 - FIGURE 4.612T Index Language l.l.a Exhaustivity of IndexLng 3 Search Rule A Document Relevance 1-2 Number of Documents in Collection 1400 Number of Questions 50 Number of Relevant Documents 155 Generality Number 2.2 Coord- Documents Recall Precision Fallout ination Retrieved Ratio Ratio Ratio x y z Level Rel. Non-rel. a/a+c a/a+b b/b+d I 146 30.918 94.2% O. 5% 2 125 44. 267% 11.726 80.6% 50 50 1.0% 50 3 87 16.789% 4,806 50 50 56.1% i. 8% 50 8. 958% 47 50 50 4 58 1,776 37.4% 5 3.2% 33 2. 543% 39 46 740 21.3"/0 46 8 21 4.3% i. 059% 287 13.5% 21 40 8.9% 40 0.411% 12 30 30 7 10 89 6.5% 8 10.2'/o 6 0.127% 18 3.9% 8 23 25. [OCRerr]o 23 9 4 57. i% o. 028,/0 4 3 2.6% 12 12 O. 004'/, 3 10 10 I0 ii 1 0 0.0% 100.0% I 8 0 0.000% 0 8 12 0 0 0 6 6 0 l i FIGURE 4.613T Index Language I. I. a Exhaustivity of Indexing 3 Search Rule A Document Relevance 1 Number of Documents in Collection 1400 Number of Questions 50 Number of Relevant Documents 95 Generality Number 1.4 Coord- Documents Recall Precision Fallout ination Retrieved Ratio Ratio Ratio x y z Level Rel. Non-tel. a/a+c a/a+b b]b+d 1 90 30,974 94.7% 0.3% 44. 309% 50 50 50 2 81 11,770 85.3% O. 7% 16. 837% 50 50 50 3 57 4.836 60.0% 1.2% 6. 918% 47 50 50 4 40 1,794 42.1% 2.2% 2. 566'/0 39 46 46 5 24 749 25.3% 3.1% 1. 071% 21 40 40 6 14 294 14.7% 4.5% 0.420% 12 30 30 7 7 92 7.4% 7.1% 0.153% 8 23 23 8 3 21 3.2% 14.3% 0.030% 4 12 12 9 2 5 2.1% 28.6% o. 007% 3 10 10 10 0 1 o. 0% o. 0% o. oo1% 1 8 8 11 0. 0 0 6 6 12 0 0 0 1 1