CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 154 - FIGURE 4.712T Index Language ll.13.a Exbauatlvity of Indexing 3 Search Rule A Document Relevance 1 - 4 Number of Documents in CoLlection 200 (Subset I) Number of Questions 42 (Subset 2) Number of Relevant Documents 199 Generality Number 23.6 (Simple Concepts. Species, Superordinate and Co-ordinate (complete). Coordination). Coord- Documents Recall Precision Fallout L[OCRerr]atiau Retrieved Ratio Ratio Ratio x y z Level Rel. Non-rel. a/a+c a/a+b b/b+d l 166 2.490 84.[OCRerr]% 6.3% 42 42 2 117 30.365% 937 59.1% 42 3 40 244 11.1% 24.7% 11.424% 16.7% 40 41 2.975% 41 29 36 36 4 20 54 10. l% 5 8 27.0% 21 4.0% 0.658% 11 32 32 6 27.6% 0 1 0.256% 0.0% 0.0% 3 20 0.012% 20 1 0 6 ? 0 o 0 3 3 FIGURE 4.713T Index Language ll. i4.a (Siraple Concepts. Species. Superordinate, Coordinate and Collateral ExhaueUvity of Iader[OCRerr]i[OCRerr]g 3 (complete). Coordination). Search Rule A Document Relevance 1 - 4 Number of Documents in CoLlection 200 (Subset 1) Number of Questions 42 (Subset 2) Number of Relevant Document8 198 Generality Number 23.6 Coord - Documerns Recall Precision inaUon FaLlout tietrieved Ratio Ratio Level Ratio Rel. Non-rel. a/a+c a/a+b b/b+d x y s I 18Q 3.[OCRerr]84 90.9% 2 143 2,047 4.0% 72.2% 0.5% 44.926% 42 42 42 3 66 600 33.3% 24. 057% 0.0% 40 7.315% 41 41 33 38 38 4 26 179 5 13.1% 13 12.7% 2.182% 10 32 32 6 59 6.6% 0 11 10.l% o. 0% 0."/19% o. 0% 7 o. 134% 20 20 2 0 9 7 O 0 0 3 3 FIGURE 4. 714T Index Language 11.15.a (Simple Concepts. Exhausttvlty of Indexing 3 Search Rule A Document Relevance I - 4 Number of Documents in CoLlection Number of Questions 42 (Subset 3) Number of Relevant Documents 199 Generality Number 23.6 Species, SuperordLuate. Coordinate. end Collateral (complete). Second alphabetical CoLlateral (selected). Coo rd inat ion ). 200 (Subset 1) Coord- Docun[OCRerr]uts inatinn RecaLl Retrieved Precision Fallout Level Ratio Ratio g Bel. Non-rel. a/a+c Ratio a/a+h b/b+d y 1 190 4,542 96.0% 2 168 2,590 4.o[OCRerr] 84.8% 55,390% 42 42 42 3 6.1% 117 1,020 31.578% 59.1% 41 41 41 lo.3% 12.436% 37 38 4 36 51 6 325 21 25.8% 13.6% 10.5% 3.962% 20 32 32 6 96 4 15 17.0% 1.170% 2.0% 21.1% 12 20 20 0.183% 5 6 9 7 0 0 0 3 3