SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
Lilts - Beilcore
Summary Statistics 1
Recall-Precision Curve
Run number IsircOl-full, automatic 1
Num4ueries 50 j
Total number of documents over all queries 1
0.8 -
Retrieved j 10000 1
Relevant 15459
Rel[OCRerr]ret 2234 0.6
Precision
call Level Averages Document Level Averages
0.4
1 Precision Recall Precision
0.6323 at 5 docs 0.0106 0.4160
0.3061 at 15 docs 0.0286 0.3893 0.2
0.1901 at 30 docs 0.0506 0.3573
0.0883 at 100 docs 0.1273 0.3024
0
0.0370 at 200 docs 0.1847 0.2234
0.0077
ROC Averages
0.0000
False Alarm Detection
0.0000
0.00000 0.0418
0.0000
0.00001 0.0513
0.0000
0.00002 0.0719
0.0000
0.00003 0.0828
e precision for all points 0.00004 0.0977
[OCRerr]vg 0.1147 I 0.00005 0.1069
e precision for 3 0.00006 0.1170
ediate points 0.00007 0.1259
).50, 0.80) 0.00008 0.1312
vg 0.0659 0.00009 0.1389
_ A-
0.8
0 0.2 0.4 0.6
Recall
NORMAL DEVIATE - Detection-False Alarm
0.001 0.02 0.16 0.5 0.84 0.98 0.9[OCRerr]
3 I I
2
1
0
-1
-2
-3
½½1
-3 -2 -1 0 2 3