CRANV2
Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2
Main test results
chapter
Cyril Cleverdon
Michael Keen
Cranfield
An investigation supported by a grant to Aslib by the National Science Foundation.
Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government.
- 90-
FIGURE 4. IIOT
Index Language L I° a (S. T. Natural language.
E[OCRerr]d[OCRerr]ustlvity of indexing 3
Search Rule A
Document Relevance 1 - 4
Number of Documents in Collection 1,400
Number of Questions 35 (Subset 1)
Number of Relevant Documents 287
Generality Number 5.9
Coordination)
Cooz'd- Documents Recall Precision Fallout
inatioa Retrieved Ratlo Ratio Ratio x y =
Level Rel, Non-rel. a/a+c aJa+b b/b+d
i 268 23,681 93.4% I. 1% 49. 329% 35 35 35
2 221 9, 096 77.0% 2.7% 16. 500% 35 35 35
3 157 2.805 54,7% 5.2% 5.e5i% 34 35 35
4 94 600 32.8% 13.5% 1. 232% 29 35 35
5 45 147 16.4% 23. [OCRerr] 0.291% 19 35 35
6 22 37 7.7% 37.2% 0. 076% 7 35 35
7 9 8 2.8% 50.0% 0. 016% 3 35 35
FIGURE 4. lItT
Index Language L 2. a (S. T. Synonyms.
Exhaustlvity of Indexing 3
Search Rule A
Document Relevance I - 4
Number of Documents in Collection 1.400
Number of Questions 35 (Subset I)
Number of Relevant Documents 287
Generality Number 5.9
Coordination)
Coord- Documente RecaLl Precision FaLlout
Ir[OCRerr]tiou Retrieved Ratio Ratio Ratio x y
Level Rel. Non-tel.. ala+e a/a+b b/b+d
l 269 (-) 93.9% (-) (-) 35 0 35
2 226 8, 514. 78.8% 2.0%, 17.357[OCRerr]u, 35 23* 35
3 164 3.026 5=7.2% 5.I% e.z12% 34 35 35
4 99 650 34.5% 13.2% 1. 334% 28 35 35
5 51 151 17.8% 25.2% 0.310% 19 35 35
6 23 39 6.0% 37.1% 0,080% 8 35 35
7 8 8 2.8% 50.0% O. 016% 3 35 35
FIGURE 4. l12T
Index Language L 3. a (S. T. Word forms. Coordination)
. Exhaustivity of Indexing 3
[OCRerr]earch Rule A
Document Relevance 1 - 4
Number of Documents in Collection 1,400
Number of Queutions 35 (Subset 1)
Number of Relevant Documents 287
Generality Number 5.9
Coord- Documents Recall Precision Fallout
Ination Retrieved Ratio Ratio Ratio x y =
Level Rel. Non-rel. a/a+c a/a+b b/b+d
1 270 (-) 94.1% (-) (-) 35 0 35
2 227 9, 174' 79.1% 2.4%[OCRerr] 19.[OCRerr] 51U%* 35 23* 35
' 3 173 3,408 59,3% 4.7% 6.996% 35 35 35
4 t03 768 35.9% 11.8% 1.577% 30 35 35
5 55 184 19.2% 23.0% 0,375% 21 35 35
6 25 44 8.8%. 36.2% 0,090% 12 35 35
.... 7 5 9 ...... [OCRerr]:_8[OCRerr] ......... 5_o..o%. ....... 3.°[OCRerr]e% .........[OCRerr] .... _3s_._[OCRerr]s__