SP500215
NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2)
Appendix A: TREC-2 Results
Appendix
National Institute of Standards and Technology
D. K. Harman
[OCRerr]`11ts - GE Researeh and Development Center
Summary Statistics j
Run Number gecrd2-full, automatic 1 Recall-Precision Curve
1
L Num of Queries 50 J
r Total number of documents over all queries 1
Retrieved: 50000 1 0.8 -
Relevant: 10785
Rel[OCRerr]ret: 6080
0.6
ecall Level Averages
Recall Precision
0.00 0.7047
0.10 0.4433
0.20 0.3753
0.30 0.3112
0.40 0.2503
0.50 0.2049
0.60 0.1496
0.70 0.0999
0.80 0.0690
0.90 0.0381
1.00 0.0088
[OCRerr]ge precision over all
[OCRerr]nt docs
nterpolated 0.2183 1
Document Level Averages
Precision
At 5 docs 0.4880
At 10 docs 0.4760
At 15 docs 0.4653
At 20 docs 0.4510
At 30 docs 0.4253
At 100 docs 0.3662
At 200 docs 0.2896
At 500 docs 0.1876
At 1000 docs 0.1216
R-Precision (precision after R
docs retrieved (where R is
the number of relevant docu-
ments))
Exact 0.2816
Precision
0.4
0.2
0
1
0.8
0 0.2 0.4 0.6 0.8
Recall
Fallout-Recall Curve
I I I
Level Averages NORMAL DEVIATE - Fallout-Recall
Recall
Recall
D 0.3221
0.4269
0.4957
0.5489
0.5850
) 0.5968
) 0.6014
) 0.6014
) 0.6014
) 0.6014
) 0.6014
0.6
101 0.02 5 0.84 0.98 0
0.4
0.2 -
2 0.98
1 0.84
0 0.5 0
0 0.05 0.1 0.15 0.2
-1 0.16 Fallout x 100
-2 0.02
-3
-3 -2 -1 0 1 2 3
0.001