CRANV2
Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2
Main test results
chapter
Cyril Cleverdon
Michael Keen
Cranfield
An investigation supported by a grant to Aslib by the National Science Foundation.
Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government.
- 125 -
FIGURE 4,410T
Index Language 1.6.a (S.T,
Exahaustivity of Indexing 2
Search l[OCRerr]ule A
Document Relevance 1 - 4
Number of Documents in CoLlection 1,400
Number of Questions 221 (Subset 3)
Number of Relevant Documents 1,590
Generality Number 5.1
J 12
I
3
4
5
6
7
8
9
10
11
12
13
14
15
Documents
Retrieved
[OCRerr]el. Non-rel.
1,53o (-)
!,389 98,743*
I,I04 36.132'
782 13,974"
467 6,701 *
261 2,549"
128 663
53 197
19 48
5 7
0 1
0 0
0 0
0
0 0
Synonyms..Quasi-synonyms, Word forms. Coordination)
Recall Precision Fallout
RatioRatio Ratio
ala+ca/a+b b/bed
96.2% (-) (_)
87.4% 1.4%* 32.089%*
69.4% 3.070* 11.739%*
49.2% 5.3%* 4.540%*
29.3% 6.5%* 2.178%*
16.4% 9.3%* 0.828%*
x y z
221 0 221
221 44* 221
215 109= 220
203 142" 212
158 177" 197
111 161" 164
74 140 140
40 105 105
18 78 78
6 52 52
1 32 32
0 15 15
0 8 8
0 4 4
0 3 3
8.1% 18.2% 0.215%
3.3% 21.2% 0.064%
1,2% 28.4% 0.016%
0.3% 41.7% 0.002%
0.0% 0.0OO3%
FIGURE 4. 411T
Index Language 1.6.a (S.T. Synonyms, Quasi-synonyms, Word forms.
Exhaustivi*,y of Indexing 1
Search Rule A
Document Relevance 1 - 4
Number of Documents in Collection 1,400
Number of Questions 221 (Subset 3)
Number of Relevant Documents 1,590
Generality Number 5.1
Coordination)
Coord- Documents
L[OCRerr]ation Recall
Retrieved Precision Fallout
Level Ratio
Rel. Non-rel. a/a+c Ratio Ratio
ala+b b/bed x y z
1 1,455 (-)
2 1,226 91.5% (-) (_)
54,263 221 0 221
3 861 77.1%
15,346" 54.2% 2.3%* 17.618%*
5.3%* 221 44* 221
4 4.982%* 212 109" 220
520
5 4.903*
261 32.7% 9.6%*
16.4% 10.6%* 1.402%* 186 .142" 212
6 2.214"
122 586* 7.7% O, 719%*
17.2%* 124
0.190%* 177' 197
7 77 161" 164
59
8 141
20 3.4% 27.7%
1.3% O. 048% 43 140 140
9 38
6 7 O. 4% 34.5% O. 012%
46.27o 22
O. 002% 105 105
10 7 78
1 78
11 1
0 0.1% 50.0% 0.0003% 2 52 52
12 0
0 0 0 32 32
13 0 15 15
0
14 0
0 0 8 8
15 0
0 0 0 4 4
0 3 3