SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
suits - GTE Laboratories
Summary Statistics
Run number fairsi-category B, automatic
1
Num[OCRerr]queries 25
Total number of documents over all queries
Retrieved 5000 0.8
Relevant 3766
Rel[OCRerr]ret 1124 0.6
Precision
ecall Level Averages Document Level Averages
Precision Recall Precision 0.4
() 0.7339 at 5 docs 0.0370 0.4560
() 0.4871 at 15 docs 0.0918 0.4480 0.2
0 0.3661 at 30 docs 0.1514 0.4200
0 0.2942 at 100 docs 0.3166 0.3136
0 0.2256 at 200 docs 0.4206 0.2248 0
0 0.1707
ROC Averages
0 0.0639
False Alarm Detection
0 0.0352
0.00000 0.0641
0 0.0208
0.00001 0.0853
0 0.0128
0.00002 0.1094
0 0.0000
0.00003 0.1166
ge precision for all points 0.00004 0.1299
Avg 0.2191 0.00005 0.1419
ge precision for 3 0.00006 0.1599
iediate points 0.00007 0.1532
0.50, 0.80) 0.00008 0.1732
[OCRerr]vg 0.1858 0.00009 0.1834
Recall- Precision Curve
0 0.2 0.4 0.6
Recall
NORMAL DEVIATE- Detection-False Alarm
0.001 0.02
3
0.16
I I
y
2
1
½
0
-1
5 0.84 0.98 0.[OCRerr]
-w
-2
-3
3 -2 -1 0 1 2 [OCRerr]