CRANV2 Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2 Supplementary tests and results chapter Cyril Cleverdon Michael Keen Cranfield An investigation supported by a grant to Aslib by the National Science Foundation. Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. - 223 - Document Relevance In Chapter 4, Section 6, the effect of relevance was considered, and the results were presented and plotted for documents of'different grades of relevance according to the coordination level cut-off. Fig. 6.3T shows the same results as are given in Figs. 4.610T to 4.613T, but now grouped accord- ing to relevance grade for each coordination level. Coordination Relevance Recall Precision Level Grade Ratio Ratio 1 1 94.7 0.3 1 -2 94.2 0.5 1-3 93.2 0.9 1 -4 94.2 1.1 2 1 85.3 0.7 1 -2 80.6 1.0 1 -3 79.1 2.0 t -4 77.8 2.4 3 1 60.0 1.2 1 -2 56.1 1.8 1-3 54.5 3.4 1-4 48.8 3.6 4 1 42.1 2.2 1 -2 37.4 3.2 1 -3 32.7 5.3 1-4 29.6 5.8 5 1 25.3 3.1 1 -2 21.3 4.3 1-3 16.5 6.4 1-4 16.3 7.6 6 1 14.7 4.5 1-2 13.5 6.9 1-3 9.8 9.2 1-4 9.7 11.4 7 1 7.4 7.1 1-2 6.5 10.2 1 -3 5.3 t 6.2 1-4 5.3 19.2 8 1 3.2 14.3 1-2 3.9 25.0 1-3 2.0 25.0 1 -4 1.9 29.2 FIGURE 6.3T RESULTS FOR INDEX LANGUAGE I. 1.a FOR 42 QUESTIONS WITH 1400 DOCUMENTS-FOR FOUR GRADES OF RELEVANCE. Plotted as a series of short graphs in Fig. 6.3P, these illustrate yet again the inverse relationship of recall and precision.