SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
Its - VPI & SU
Summary Statistics
Run number vpidt2-wsj, diski only, manual
1
Num[OCRerr]queries 50
Total number of documents over all queries
0.8
Retrieved 10000
Relevant 4056
Rel[OCRerr]ret 1371 0.6 -
Recall-Precision Curve
call Level Averages
I Precision
0.5153
0.2841
0.1898
0.1285
0.0988
0.0746
0.0527
0.0338
0.0271
0.0222
0.0222
e precision for all points
Lvg 0.1317
e precision for 3
diate points
[OCRerr].50, 0.80)
vg 0.0972
Precision
Document Level Averages
Recall Precision 0.4
at 5 docs 0.0476 0.3160
at 15 docs 0.0640 0.2147 0.2 -
at 30 docs 0.0843 0.1760
at 100 docs 0.2050 0.1246
at 200 docs 0.4481 0.1371 0
0 0.2 0.4 0.6 0.8
ROC Averages Recall
False Alarm Detection
0.00000 0.0391
0.00001 0.0452
0.00002 0.0529
0.00003 0.0522
0.00004 0.0595
0.00005 0.0616
0.00006 0.0607
0.00007 0.0633
0.00008 0.0677
0.00009 0.0661
NORMAL DEVIATE - Detection-False Alarm
a
I I I
0.01
3
2
1
0
-1
-2
-3
0.02 0.16 0.5 0.84 0.98 0.9[OCRerr]
-3 -2 -1 0 2 3