SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
ults - Universitaet Dortmund
Summ&y Statistics ]
Run number fuhra2-full, automatic 1 1
Num[OCRerr]queries 50
Total number of documents over all queries
0.8
Retrieved 10000
Relevant 15459
Rel[OCRerr]ret 4221 0.6
Precision
[OCRerr]all Level Averages Document Level Averages
0.4
11 Precision Recall Precision
0.7630 at 5 docs 0.0124 0.6040
0.6153 at 15 docs 0.0378 0.6000 0.2
0.4279 at 30 docs 0.0760 0.5947
0.3089 at 100 docs 0.2088 0.5328
0.1686 at 200 docs 0.3121 0.4221 0
0.0516 ROC Averages
0.0203
False Alarm Detection
0.0036
0.00000 0.0926
0.0000
0.00001 0.1286
) 0.0000
0.00002 0.1573
) 0.0000
0.00003 0.1796
[OCRerr]recision for all points] 0.00004 0.2013
[OCRerr]vg 0.2145 J 0.00005 0.2174
iediate points 0.00006 0.2300
[OCRerr]e precision for 3 0.00007 0.2457
0.50, 0.80) 0.00008 0.2563
[OCRerr]vg 0.1598 0.00009 0.2660
Recall-Precision Curve
0 0.2 0.4 0.6 0.8
Recall
NORMAL DEVIATE - Detection-False Alarm
U . 9
I I
0.01 0.02
3
2
1
0
-1
-2
-3
0.16 a
0.84 0.98 0.
-3 -2 -1 0 1 2