CRANV2
Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2
Main test results
chapter
Cyril Cleverdon
Michael Keen
Cranfield
An investigation supported by a grant to Aslib by the National Science Foundation.
Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government.
[OCRerr] 93 -
FIGURE 4. 120T
C˘ rd-
ir[OCRerr] ion
L ;el
Index Language L I. a (S. T. Natural language. Coordination)
Exhaustivity of Indexing 3
Search Rde A
Document Relevance 1 - 4
Number of Documents in CoLlection
Number of Questions 42 (Subset 2)
Number of Relevant Documents 198
Generality Numo˘.r 3.4
-----.---____._._
Documents Heeall
Retrieved Ratio
Rel
189
162
132
68
49
25
12
4
0
0
0
0
Noa-rel. a/a-re
34, 127 95.5%
9, 811 81.6%
3,979 66.7%
1. 029 44.4%
251 24.7%
56 12.6%
n 6.1%
1 2.0%
1 0.0%
0
0
0
1.400
Precision Fallout
Ratio Ratio
a/a+b b]b+d
0. 6% 57. 068%
1.6% 16. 406%
3.2% 6. 790%
7.8% 1. 772%
16, 3% 0,428%
30.9% o. 096%
52.2% O. 019%
80.0% O. 002%
o. 0% o. 002%
8
9
10
11
12
13
14
15
x y z
42 42 42
42 42 42
42 42 42
30 41 41
25 39 39
16 33 33
8 27 27
2 18 16
1 11 11
O 7 7
0 3 3
0 1 1
FIGUBE 4. 121T
Index Language 1. 2. a (S. T. Synonyms.
Exhaustivity of Indexing 3
Search Rule A
Doeumenl Relevance 1 - 4
Number of Documents in Collection 1.400
Number of Questions 42 (Subset 2)
Number of Relevant Documents 198
Generality Number 3.4
Ination
Level
1
2
3
4
5
6 I
7
8
9
I0
11
12
13
14
15
Documents
Retrieved
Rel. Non-rel.
189 (-)
165 I0,47[OCRerr]
134 4,614
90 1,244
55 320
25 67
12 15
4 1
0 1
0 0
0 0
0 0
Coordination)
RecaLl Precision FaLlout
Ratio Ratio Ratio
a/a+c a/a+b b/b+d
95.5% (-) (_)
83.370 1.6%* 17.510%,
67. 770 2.8% 7.873%
45.5% 6.7% 2.123%
27.8% 14,7% 0.546%
12.6% 27.2% 0.114%
6.1% 44.4% 0.026%
2.07, 8o. 0% o. 002%
o. 0% o. 0% o. 002%
x y z
42 0 42
42 6* 42
42 42 42
38 41 41
27 39 39
16 33 33
10 27 27
2 18 18
1 11 11
0 7 7
0 3 3
0 1 l