SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
`its - Queens College, CUNY
L Summ&y Statistics1 Recall-Precision Curve
Run number pircs3[OCRerr]ategory B, 1
Num4ueries feedbac2k5
Total number of documents over all queries
0.8<
Retrieved 5230 1
Relevant 3318
Rel[OCRerr]ret 1526 0.6
Precision
Document Level Averages
0.4
ecall Level Averages Recall Precision
Lll Precisi6n at 5 docs 0.0725 0.6400
0.7970 at 15 docs 0.1325 0.5467 0.2
[) 0.6978 at 30 docs 0.2090 0.4920
[) 0.5873 at 100 docs 0.4559 0.3920 I-
0
D 0.4398 at 200 docs 0.6163 0.2970 0 0.2 0.4 0.6
() 0.3595 ROC Averages Recall
0 0.2982 False Alarm Detection
0 0.2460 NORMAL DEVIATE - Detection-False Alarm
0.00000 0.1409
0 0.1700 0. 001 0.02 0.16 0.5 0.84 0.98 0.1
0.00002 0.1911 3
0 0.0898
0.00004 0.2198
0 0.0489
0.00006 0.2751
0 0.0136
0.00008 0.2806
.[OCRerr]ecision for all points 1 0.00010 0.2931
Avg 0.3407 0.00012 0.3500
ge precision for 3 0.00014 0.3654
[OCRerr]diate points 0.00016 0.3668
0.50, 0.80) 0.00018 0.4119
[OCRerr]vg 0.3251 0.00020 0.3941
2
1
0
-1
-2
-3
-3 -2 -1 0 1 2