SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
`suits - University of Illinois at Chicago
Summary Statistics
Run number danyul-full, automatic 1
Num[OCRerr]queries 50
Total number of documents over all queries
Retrieved 9999
Relevant 15459
Rel[OCRerr]ret 1253
ecall Level Averages
Precision
0.4415
0.1044
0.0154
0.0000
0.0000
0.0000
0.0000
0.0000
0.0000
0.0000
0.0000
;e precision for all points
0.0510
,[OCRerr] precision for 3
[OCRerr]diate points
).50, 0.80)
vg 0.0051
I
J
Document Level Averages
Recall Precision
at 5 docs 0.0041 0.2480
at 15 docs 0.0111 0.2240
at 30 docs 0.0192 0.1907
at 100 docs 0.0500 0.1536
at 200 docs 0.0804 0.1253
ROC Averages
False Alarm Detection
0.00000 0.0116
0.00001 0.0195
0.00002 0.0256
0.00003 0.0264
0.00004 0.0322
0.00005 0.0371
0.00006 0.0406
0.00007 0.0451
0.00008 0.0482
0.00009 0.0507
Recall-Precision Curve
1
0.8
0.6
Precision
0.4
0.2
0 A
0 0.2 0.4 0.6 0.8
Recall
NORMAL DEVIATE. Detection-False Alarm
0.001 0.02 0.16 ( 5 0.84 0.98 0.9'
3
0
-1
-2
-3
`7! I
-3 -2 -1 0 2 3