CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Main test results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 150 - FIGURE 4.700T Index Language II. 1.a (Simple concepts. Natural language. Coordination) ExhaustlWity of Iadexing 3 Search Rtde A Document Relevance 1 - 4 Number of Documents in CoLlection 200 (Subset 1) Number of Questions 42 (Subset 2) Number of Relevant Documents 198 GeneraLity Number 23.6 Coord - Documents Ination Recall Retrieved Precision FaLlout Level Ratio Rel. Non-rel. Ratio a/a+c Ratio a/a+b h/b+d x y z 1 73 2 459 28 36.9% 13.7% 14,1% 90.9% 5.597% 42 42 42 3 27 10 0 5.1% 0.329% I00.0% 18 0.000% 41 41 4 5 38 0 38 5 O 0 0 0 32 32 0 0 0 0 20 20 7 0 0 9 9 0 0 3 3 FIGURE 4.701T Index Language I1.2. a Exhauetivity of Indexing 3 Search Rule A Document Relevance 1 - 4 Number of Documents in CoLlection Number of Questions 42 (Subset 2) Number of Relevant Documents 198 Generality Number 23.6 (Simple Concepts. Synonyms. 200 (Subset 1) Coordinat ion) Coord- Documents Recall Ination Precision Retrieved FaLlout Ratio Level Rel. Ratio Non-rel. Ratio a/a.c a/a+b x blb+d y z 1 I01 2 635 51.0% 44 13.7% 65 22.2% 7,743% 42 42 42 3 I0 40.4% 2 5.1% 0.792% 93.3% 25 41 0.024% 41 6 38 4 38 2 5 0 0 1.0% 1oo.o% 0.000% 2 32 32 6 0 0 0 0 20 20 O 0 7 9 0 0 O 3 3 FIGURE 4. 702T Index Language Ll,3.a (Simple Concepts. Species (selected).Coordination) Exhauatlvity of Indexing 3 Search Rule A Document Relevance 1 - 4 Number of Documents in Collection 200 (Subset 1) Number of Questions 42 (Subset 2) Number of Relevant Documents 198 Generality Number 23.6 Coord- Documents Rcca[OCRerr] ination Retrieved Precision FaLlout Level Ratio Rcl. Non-tel. Ratio a/a*c Ratio a/a+b x b/b+d y z 1 115 l,Ol0 58.1% 2 60 155 10.2% 12.317% 30.3% 42 42 42 3 24 8 34.3% 1.890% 12.1% 75.0% 32 41 0.098% 41 12 38 38 4 4 0 5 0 2.0% 100,0% 0 0.000% 3 32 32 6 0 0 0 20 20 0 9 9 7 0 0 0 3 3