CRANV2
Aslib Cranfield Research Project: Factors Determining the Performance of Indexing Systems: Volume 2
Main test results
chapter
Cyril Cleverdon
Michael Keen
Cranfield
An investigation supported by a grant to Aslib by the National Science Foundation.
Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government.
- 142 -
FIGURE 4. 003T
Index Language I.'6. a {S. T. Synonyms, Quasi-synonyms, Word forms. Coordination)
Exhauntlvity of Indexing 3
Search Rule A
Document Relevance I - 2
Number of Documents In Collection 1.400
Number of Questions 25 (8 questions had no relevant docqments)
Number of Relevant Documents 79
Generality Number 1. fi
Coord- Doculllentn Recall Precision FaLlout
Ination Retrieved Ratio Ratio Ratio x y z
Level Rel. Non-rel. a/a+c a/a÷b b/bed
I 76 {-1 98.7% (-) (-) 0
2 70 35
19,449" 88.6% 35
0.4%* 39.691%* 35 23*
3 53 0.219 67.1% 0.6% 35
16.601% 35 35 35
4 37 2,51{} 46.6% 1,4% 5.149% 35 35
5 24 619 30.4% 35
3.7% 1.265% 30
6 17 130 21.6% 35 35
11.6% 0.266% 18 35 35
7 0 26 v.0% 16.6% 0.053% 6 35 35
FIGURE 4. 604T
Index Language I. 1.a (S.T. Natural language. Coordination)
Exhaustlvity of Indexing 3
Search Rule A
Document Relevance I
Number of Documents In Co].lectlon 1,400
Number of Questions 35 (24 questions had no relevant documents)
Number of Relevant Documents 18
Generality NumberO. 4
Rel.
17 23,932
16 8.291
12 3,014
8 666
5 186
2 56
2 14
Documents Recall Precision Fallout
Retrieved Ratio Ratio Ratio x y ¢
Non-tel. a/a+c a/a4b b/bed
94,4% 0.1% 48,840%
88.9% 0.2% 16.920%
68.7% 0.4% 6.145%
44.4% 1.2% 1.401%
27.8% 2.6% 0,304%
11.1% 3.3% 0.116%
11.1% 12.5% 0.020%
35 35 35
35 35 35
34 35 35
26 35 35
16 35 35
7 35 35
3 35 35
FIGURE 4. 605T
Index Language l.fi.a (S.T. Synonyms. Quasi-synonyms. Word forms.
Exhauntivity of Indexing 3
Search Rule A
Document Relevance 1
Number of Documents in Collection 1.400
Number of Questions 35 (24 questlona had no relevant documents)
Number of Relevant Documents 18
Generality Number 0.4
Documents
Retrieved
Rel__ Non-tel.
16 (-)
16 19.503'
13 8,259
lO 2,546
8 636
6 141
7--J-] 3 29
Coordination)
1oo. 0% (-) (-)
88.9% 0.1%* 39.602%
72.2% 0.2% 16.881%
55.6% 0.3% 5.195%
50.0% 1.4% 1.208%
33.3% 4.1% 0.288%
16.7% 0.4% 0.050%
35 0 35
35 23* 35
35 35 35
35 35 35
30 35 35
18 35 35
6 35 35
Recall Precision Fallout
Ratio Ratio Ratio x y s
a/a+c a/a+b b/bed