SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
Lilts - City University, London
Summary Statistics
Run number citya 1-full, automatic Recall-Precision Curve
1
Num[OCRerr]queries 50
Total number of docu[OCRerr]nents over all queries
Retrieved 9989 0.8 -
Relevant 16400
Rel[OCRerr]ret 2722
0.6 -
ecall Level Averages Document Level Averages Precision
Lii Precision Recall Precision 0.4
[) 0.7089 at 5 docs 0.0122 0.4960
[) 0.3855 at 15 docs 0.0298 0.4600
0.2
[) 0.1727 at 30 docs 0.0504 0.4207
[) 0.0594 at 100 docs 0.1276 0.3462
A A
[) 0.0089 at 200 docs 0.1892 0.2722 0
[) 0.0000 0 0.2 0.4 0.6
ROC Averages Recall
[) 0.0000
False Alarm Detection
[) 0.0000
0.00000 0.0379 NORMAL DEVIATE - Detection-False Alarm
[) 0.0000
0.00001 0.0555 0.001 0.02 0.16 C 5 0.84 0.98 0. 9
[) 0.0000
0.00002 0.0734 3
[) 0.0000
0.00003 0.0847
[OCRerr]r[OCRerr]cision for all pointsl ½<½
0.00004 0.0985 2
[OCRerr]vg 0.1214
0.00005 0.1086
[OCRerr]e precision for 3 0.00006 0.1200
Lediate points 0.00007 0.1291
0.50, 0.80) 0.00008 0.1377 0
[OCRerr]vg 0.0576 0.00009 0.1442
-1
-[OCRerr]
-2
-3 I II
-3 -2 -1 0 2 3