SP500215
NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2)
Appendix A: TREC-2 Results
Appendix
National Institute of Standards and Technology
D. K. Harman
resjilts - GE Research and Development Center
[ Summary Statistics ]
[ Run Number gecrdl-full1 manual 1 Recall-Precision Curve
1
Num of Queries 50
Total number of documents over all queries
Retrieved: 44004 0.8
Relevant: 10489
Rel[OCRerr]ret: 6118
[OCRerr]ecall Level_Averages
Recall Precision
0.00 0.8112
0.10 0.6131
0.20 0.5320
0.30 0.4518
0.40 0.3988
0.50 0.3305
0.60 0.2198
0.10 0.2196
0.80 0.1393
0.90 0.0868
1.00 0.0130
age precision over all 1
ant docs J
interpolated 0.3308 ]
Level Averages
t Recall
0 0.3899
0 0.4141
0 0.5113
0 0.5400
0 0.5625
0 0.5186
0 0.5932
0 0.6086
0 0.6220
0 0.6291
0 0.6381
0.6
Document Level Averages Precision
Precision 0.4
At 5 docs 0.6080
At 10 docs 0.6060
At 15 docs 0.5821 0.2
At 20 docs 0.5660
At 30 docs 0.5440
0
At 100 docs 0.4528
At 200 docs 0.3364
At 500 docs 0.2045
At 1000 docs 0.1236
R-Precision (precision after R
1
docs retrieved (where R is
0 0.2 0.4 0.6 0.8
Recall
Fallout-Recall Curve
II>¼½
the number of relevant docu-
ments)) 0.8
Exact 0.3812
0.6
NORMAL DEVIATE - Fallout-Recall
)01 5 0.84 o.gs
[OCRerr][OCRerr]999 0.4<
2 0.98
0.2
1 0.84
0 0.5 0
0 0.05 0.1 0.15 0.2
-1 0.16
Fallout x 100
-2 0.02
-3 0.001
Recall
-3 -2 -1 0 1 2 3