SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
suits - Advanced Decision Systems
I
[
Summary Statistics
Run number adsba1[OCRerr]ategory B, automatic 1
Num4ueries 25
Total number of documents over all queries
0.8
Retrieved 4698
Relevant 3766
Rel[OCRerr]et 572 0.6
Precision
ecall Level Averages Document Level Averages
0.4
Lll Precision Recall Precision
0.3889 at 5 docs 0.0118 0.1680
() 0.1508 at 15 docs 0.0220 0.1467 0.2
() 0.1210 at 30 docs 0.0442 0.1493
0 0.0957 at 100 docs 0.1137 0.1244
0 0.0623 at 200 docs 0.1771 0.1144 0
0 0.0307 ROC Averages
0 0.0301 False Alarm Detection
0 0.0051
0.00000 0.0268
0 0.0000
0.00001 0.0329
0 0.0000
0.00002 0.0225
0 0.0000
0.00003 0.0459
ge precision for all points ] 0.00004 0.0306
Avg 0.0804 ] 0.00005 0.0324
ge precision for 3 0.00006 0.0499
[OCRerr]ediate points 0.00007 0.0517
0.00008 0.0545
0.00009 0.0561
}
0.50, 0.80)
[OCRerr]vg 0.0506
Recall-Precision Curve
0 0.2 0.4 0.6
Recall
NORMAL DEVIATE Detection-False Alarm
0.001 0.02
3
0.16 0.5 0.84 0.98 0.[OCRerr]
2
½½I
1
0
-1
-iw
-2
-3 I I I I
-3 -2 -1 0 2