CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 152 - FIGURE 4. 706T Index Language II.7.a ([OCRerr]hup:e Concepts. Co-ordlnate and Collateral (Selected). Exhauativlty of Indexing 3 Search Rule A Document Relevance I - 4 Ntlmber of Documents in Collecti,[OCRerr]r. 200 (Subset 1) Number of Questions 42 (Sub[OCRerr],'. 2} Number of Relevant Documents 198 Generality Number 23.6 Coord - Inatlon Documents RecaLl Precision FaUout Level Retrieved Rel. Non-rci. Ratio a/a+c Ratio Ratio a/a+b b/b+d x y z I 137 2 75 1.532 69.2% 318 [OCRerr].2% 42 43 42 23 37.9% 18.682% 3 50 11.6% 19.1% 33 41 41 14 38 38 I 4 32 33 o 0 ] 3.0% 31.5% 3.877% 4 0.810% 8 6 9 o I 40.0% I 0.5% IO0. o% 0,110% 8 0.000% 1 20 2O 7 o I o I 0 9 9 0 3 3 Coordination) FIGURE 4.707T Index Language II.8.a Exhauelivtty af Indexing 3 Search Rule A DOcument Relevance l - 4 Number of Documents in Collection Number of Questions 42 (Subset 2) Number of Relevant Documents 198 Generality Number 23.6 Coord- I lnation I Level I i H t , I (Simple Concepts. Species. Superordinate, Coordinate and Collateral (Selected). Coordination) 200 (Subset I) DocumerrtB _[OCRerr]ecall Precision Fallout Re[OCRerr]rleved Ratio Ratio Ratio x y u Rel. Non-ret. a/a+c a/a+b b/b+d 159 2.133 99 355 38 123 14 33 5 il 0 0 0 a0.3% 8.9% 28.012% 50.0% 14.1% 7.370% 19.2% 23.6% 1.500% 7.1% 29.8% 0.402% 2.5% 38.5% 0.088% 0.0% o,o% o.o12% 42 42 42 40 41 41 33 38 38 I0 32 32 2 20 20 I 9 8 0 3 3 FIGURE 4. 700T Index Language ll.9.a (Simple Concepts. First alphabetical collateral (Selected). Coordination). ExhauaUvity of IndexLug 3 Search Rule A Document Relevance 1 - 4 Number of Documents in CollecIlon 200 (Subset 1) Number of Questions 42 (Subset 2) Number of Relevant Doct[OCRerr]mente 198 Generality Number 23.6 Coord- Documents InaUon Recall Precision Fallout Level Retrieved Rel. Non-rel. Ratio a/a+c Ratio a/a+b Ratio b/b+d x y 1 135 2 1.524 75 88.2% 8.l% 37.9% 18,585% 42 42 42 3 285 37 45 20.2% 18,7% 3.809% 45.1% 33 0.549% 41 41 19 4 38 13 38 fi 5 I 5.8% 68.4% 0.5% 0.073% 8 32 32 6 2 0 0 83.6% 0.024% 3 20 20 7 0 9 8 0 o o 3 8