CRANV2
Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2
Main test results
chapter
Cyril Cleverdon
Michael Keen
Cranfield
An investigation supported by a grant to Aslib by the National Science Foundation.
Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government.
- 123 -
FIGURE 4. 402T
Index Language I. 1 .a (S. T. Natural language.
Exhausti[OCRerr]rity of Indexing 2
Search Rule A
Document Relevance 1 - 4
Number of Documents in Collection 1,400
Number of Questions 35 (Subset I)
Number of Relevant Documents 287
GeneraLity Number 5.9
Coordination)
Coord-
ination
Level
1
2
3
4
5
6
7
Documents
Retrieved
Eel. Non-rel.
263 (-)
211 6,823*
141 2,442
85 488
43 94
23 20
8 8
Recall
Ratio
a/a+c
91.7%
73.6%
49.2%
29.7%
15.0%
8.0%
2.a%
Precision
Ratio
a/a+b
(-)
3.0%*
5.4%
15.0%
31.4%
53.5%
50.0%
Fallout
Ratio
b/b+d
(-)
13. 924 %*
5. o! 3%
i. 002%
0. 103%
0.041%
0.016%
35
35
34
25
17
6
3
0
23*
35
35
35
35
35
35
35
35
35
35
35
35
FIGURE 4. 403T
Index Language I. 1. a (S. T.
Exhaustivity of Indexing 1
Search RUle A
Document Relevance I - 4
Number of Documents in Collection
Number of Questions 35 (Subset 1)
Number of Relevant Documents 287
Generality Number 5.9
Natural language.
1,400
Coordination, )
Coord-
ination
Level
1
2
3
4
5
6
7
Documents
Retrieved
Rel. Non-rel.
237 (-)
184 3,532[OCRerr]
iii 1,045
54 168
22 19
10 2
5 2
Recall
Ratio
a/a+e
82.6%
64.1%
38.7%
18.9%
7.7%
3.5%
1.8%
J
Precision
Ratio
a] a+b
(-)
4.9%*
0.6%
24.3%
53.7%
83.3%
71.4%
Fallout
Ratio
b/b+d
(-)
7.208%*
2.145%
0.345%
0.039%
0.004%
0.004%
X
35
35
34
22
6
5
3
Y
0
23*
35
35
35
35
35
35
35
35
35
35
35
35