SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
its - GTE Laboratories
Summary Statistics
Recall-Precision Curve
Run number fairs2-wsj, disk2 only, automatic 1
Num4ueries 50
Total number of documents over all queries
0.8
Retrieved 10000
Relevant 2172
Reljet1188I 0.6
Precision
[OCRerr]all Level Averages Document Level Averages
0.4
Precision Recall Precision
0.5538 at 5 docs 0.0592 0.3440
0.4134 at 15 docs 0.1500 0.2947 0.2
0.3582 at 30 docs 0.2355 0.2673
) 0.3148 at 100 docs 0.4410 0.1876 I I
0
) 0.2551 at 200 docs 0.5362 0.1188 0 0.2 0.4 0.6 0.8
) 0.1907 ROC Averages Recall
) 0.1427 False Alarm Detection
0.1086 NORMAL DEVIATE - Detection-False Alarm
0.00000 0.0622
[) 0.0603 0. 0 Ol 0.02 0.16 0.5 0.84 0.98 0.9
0.00001 0.0758 3
() 0.0312
0.00002 0.0873
[) 0.0092
0.00003 0.0873
2
ge precision for all points 0.00004 0.0964
0.2216 0.00005 0.1198
1
ge precision for 3 0.00006 0.1350
[OCRerr]ediate points 0.00007 0.1350
0
0.50, 0.80) 0.00008 0.1421
[OCRerr]vg 0.2030 0.00009 0.1470
-1
-2
-3
I I
3 -2 -1 0 2