SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
;u'ts - City University, London
Summary Statistics ]
Run number citymi-full, manual 1 Recall- Precision Curve
Num[OCRerr]queries 50 1
Total number of documents over all queries
Retrieved 9898 0.8.
Relevant 16400
Rel[OCRerr]ret 3042
0.6 -
b[OCRerr]ecall Level Averages Document Level_Averages Precision
all Precision Recall Precision 0.4
0 0.7813 at 5 docs 0.0129 0.5760
0 0.4481 at 15 docs 0.0328 0.5000
0.2
0 0.2399 at 30 docs 0.0593 0.4573
0 0.0938 at 100 docs 0.1514 0.3818
0 0.0506 at 200 docs 0.2224 0.3042 0
0 0.0425
0 0.0166 ROC Averages
False Alarm Detection
0 0.0154
0 0.0147 0.00000 0.0525
0 0.0133 0.00001 0.0735
0 0.0000 0.00002 0.0940
0.00003 0.1097
for all points
0.00004 0.1243
Avg 0.1560 J
0.00005 0.1360
ge precision for 3 0.00006 0.1456
iediate points 0.00007 0.1565
0.00008 0.1631
I 0.00009 0.1715
0.50, 0.80)
[OCRerr]vg 0.0990
0 0.2 0.4 0.6 0.
Recall
NORMAL DEVIATE - Detection-False Alarm
0. `01 0.02
3
0
-1
-2
-3
0.16 (
5
C ).
I I I I
0.84 0.98 0.1
-3 -2 -1 0 2