SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
Its - Universitaet Dortmund
Summary Statistics
Run number fuhrp2-fulI, automatic
Num[OCRerr]queries 50
]
1
1
Total number of documents over all queries
0.8
Retrieved 10000
Relevant 16400
Rel[OCRerr]ret 3613 0.6 -
Recall- Precision Curve
call Level Averages
Precision
0.7236
0.5083
0.3641
0.2350
0.1722
0.1116
0.0508
0.0479
0.0234
0.0228
0.0000
;e precision for a[OCRerr]ll points
[OCRerr]vg 0.2054 I
e precision for 3
ediate points
).50, 0.80)
0.1664
Precision
Document Level Averages
0.4
Recall Precision
at 5 docs 0.0142 0.5440
at 15 docs 0.0393 0.5293 0.2
at 30 docs 0.0740 0.5140
at 100 docs 0.1950 0.4468
at 200 docs 0.2829 0.3613 0
0 0.2 0.4 0.6 0.8
ROC Averages Recall
False Alarm Detection
0.00000 0.0841
0.00001 0.1194
0.00002 0.1477
0.00003 0.1678
0.00004 0.1865
0.00005 0.2027
0.00006 0.2140
0.00007 0.2254
0.00008 0.2346
0.00009 0.2439
NORMAL DEVIATE - Detection-False Alarm
0.001 0.02 0.16
3
2
1
0
0.5 0.84 0.98 0.9'.
½½'
I I
-1
-2
-3 I I I I
-3 -2 -1 0 2 3