SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
[OCRerr]ults - CITRI, Royal Melbourne Institute of Technology
L
t
Summary Statistics
Run number citri3-full, automatic Recall-Precision Curve
Num[OCRerr]queries 50 1
Total number of documents over all queries
Retrieved 10000
Relevant 16400
Rel[OCRerr]et 2011
[OCRerr]call Level Averages Document Level Averages
Recall Precision
at 5 docs 0.0109 0.5000
at 15 docs 0.0289 0.4453
at 30 docs 0.0553 0.4320
at 100 docs 0.1162 0.3080
at 200 docs 0.1431 0.2011
all Precision
0 0.7436
0 0.2834
0 0.1325
0 0.0742
() 0.0192
() 0.0147
[) 0.0120
[) 0.0000
) 0.0000
) 0.0000
) 0.0000
;e precision for all points
[OCRerr]vg 0.1163
r,eprecisionfor3l
ediate points
).50, 0.80) I
vg 0.0491
0.8 -
0.6
Precision
0.4
0.2
0
0 0.2 0.4 0.6
ROC Averages
False Alarm Detection Recall
0.00000 0.0480 NORMAL DEVIATE - Detection-False Alarm
0.00001 0.0675
0.00002 0.0824 0 `C Ol 0.02 0.16 0.5 0.84 0.98 0.[OCRerr]
3
0.00003 0.0931
0.00004 0.1019
0.00005 0.1083
0.00006 0.1140
0.00007 0.1200
0.00008 0.1241
0.00009 0.1269
2
1
0
-1
-2
-3
-3 -2 -1 0 1 2 3