SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
Its - Siemens Corporate Research, Inc.
[ Summ&y Statistics
L Run number siemsl-full, automatic 1 1
Num[OCRerr]quenes 50
Total number of documents over all queries
0.8
Retrieved 9992
Relevant 16400
Rel[OCRerr]et 3393 0.6
Precision
[OCRerr]all Level Averages Document Level Averages
0.4
11 Precision Recall Precision
0.7524 at 5 docs 0.0131 0.5200
0.4670 at 15 docs 0.0344 0.4827 0.2
0.3242 at 30 docs 0.0650 0.4687
0.1973 at 100 docs 0.1687 0.4100
0
0.1179 at 200 docs 0.2564 0.3393
0.0672 ROC Averages
0.0241 False Alarm Detection
0.0000
0.00000 0.0660
) 0.0000
0.00001 0.0959
) 0.0000
0.00002 0.1194
) 0.0000
0.00003 0.1369
[OCRerr]e[OCRerr]cision for all points[OCRerr] 0.00004 0.1558
[OCRerr]vg 0.1773 J 0.00005 0.1675
[OCRerr] precision for 3 0.00006 0.1775
Lediate points 0.00007 0.1897
0.00008 0.1971
0.00009 0.2065
I
0.50, 0.80)
[OCRerr]vg 0.1305
Recall-Precision Curve
A
0 0.2 0.4 0.6 0.8
Recall
NORMAL DEVIATE - Detection-False Alarm
0.001 0.02 0.16 0.5 0.84 0.98 0.9
3
2
1
0
-1
½<½'
-2 -[OCRerr]
-3
-3 -2 -1 0 2