SP500215
NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2)
Appendix A: TREC-2 Results
Appendix
National Institute of Standards and Technology
D. K. Harman
results - GE Research and Development Center
Summary Statistics
Run Number gecrd2-full, automatic 1
Num of Queries 50
Total number of documents over all queries
0.8
Retrieved: 49261
Relevant: 10489
Rel[OCRerr]ret: 4485 0.6
Recall-Precision Curve
Recall Level_Averages
Recall Precision
0.00 0.6802
0.10 0.3796
0.20 0.3111
0.30 0.2581
0.40 0.2108
0.50 0.1600
0.60 0.1015
0.10 0.0611
0.80 0.0360
0.90 0.0150
1.00 0.0009
[OCRerr]rage precision over all
`vant docs
i-interpolated 0.1772
ut Level Averages
[OCRerr] Recall
[OCRerr]00 0.2109
020 0.2171 2
040 0.3179
060 0.3513 1
080 0.3156
0
100 0.3987
120 0.4178 -1
140 0.4340
160 0.4458 -2
180 0.4559
-3
200 0.4671
Document Level Averages Precision
Precision 0.4
At 5 docs 0.4760
At 10 docs 0.4460
0.2
At 15 docs 0.4280
At 20 docs 0.4130 0 0.2 0.4 0.6 0.81
At 30 docs 0.3907 0
At 100 docs 0.2930
At 200 docs 0.2275 Recall
At 500 docs 0.1385
At 1000 docs 0.0897
Fallout-Recall Curve
R-Precision (precision after R 1
docs retrieved (where R is
the number of relevant docu-
ments)) 0.8
Exact 0.2342
NORMAL DEVIATE - Fallout-Recall
Recall
0.6 -
P01 0.84 0.98 0 )[OCRerr]999 0.4
0.98
0.2
0.84
0.5 0
0 0.05 0.1 0.15 0.2
0.16 Fallout x 100
0.02
0.001
-3 -2 -1 0 1 2 3