CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 151 - FIGURE 4. 703T Index Language II.4,a Exhaustlvlty of Indexing 3 Search Rule A Document Relevance 1 - 4 Number of Documents Jn Co[OCRerr]ection Number of Questions 42 (Subset 2) Number of Relevant Documents 198 GeneraLity Number 23.6 (Simple concept[OCRerr]. Superordinate (Selected). Coordination) 2o0 (Subset 1) Coord- Documents ination Recall Precision Ratio Fallout Level Retrieved Re1. Non-rel. a/a+c Ratio s/a+b Ratio b/b+d x y z I 129 2 67 1,336 65.2% 33.8% 8.8% 20.8% 16.292% 42 42 .42 3 255 19 40 9.6% 32.2% 3.109% 0.486% 36 41 41 4 16 2 38 38 6 8 0 1.0% 20.0% 0.0% 0.098% 4 32 32 8 2 0 i 0.0% 0. o[OCRerr] 0.024% 0.0% I 0,012% 20 20 ? I 0 9 0 9 0 3 S .............................. I .-w FIGURE 4.704T Index Language I/. 5,a (Simple concepts. Species and Superordlnate (Selected). Coordination) Exhauatlvlty of Indexing 3 Search Rule A Document Relevance 1 - 4 Number of Documents in CoLlection 200 (Subset I) Number of Questions .42 (Subset 2) Number Of Relevant Docmnents 196 GeneraLity Number 23.fl Coord- Documents Inatinn Retrieved RecaLl Precision Fallout Level Rel. Non[OCRerr]tel. Ratio a/a+c RatJo a/a[OCRerr]b Ratio h/b[OCRerr]d x y z 1 138 2 1,614 81 69.7% 359 40.9% 7.8% 18.4% 19.682% 42 42 42 3 32 60 16.2% 34.8% 4.377% 39 0.732% 41 41 22 4 38 0 38 o 10 l 5 3.0% 37.5% 0.0% 0.122% 5 32 32 9 4 0 i 0.0% 0.0% o.o49% 0.0% 1 0. 012% 2O 20 1 9 7 9 0 0 0 3 3 FIGURE 4. 705T Index Language ll.6.a (Simple Concepts. Co-ordinate (Selected). Coordination) Exhaustlvity of Indexing 3 Search Rule A Doctunent Relevance 1 - 4 Number of Documents in CoLlection 200 (Subset i) Number of Questions 42 (Subset 2) Number of Relevant "Documents 198 Generul.tty Number 23.6 Coord- Documents Ination Recall Retrieved Precision Fallout Level Rel. Non-rel. Ratio a/aśc Ratio Ratio a/a+b = b/b+d x y 1 118 2 1,124 59.6% 57 9,5% 28.8% 26.9% 13.707% 42 42 42 3 ' 155 18 26 9.1% 1.800% 40.9% 33 0.210% 41 41 II 4 38 38 4 8 5 2,0% 44.4% 0.061% 4 32 32 6 0 0 0 0 0 20 20 0 9 7 .9 0 0 0 3 3