SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
hsults - Australian Computing and Communications Institute
Summary Statistics
Recall-Precision Curve
Run number manual 1
50
Total number
0.8 -
Retrieved 8531
Relevant 15459
IRel[OCRerr]ret3l68 0.6
[OCRerr]call Level Averages
all Precision
0.6690
LO 0.4610
0.2867
0.1662
0.0839
0.0179
0.0164
0.0000
0.0000
0.0000
[)0 0.0000
[OCRerr]ge precision for all points
Avg 0.1547 J
age precision for 3
rnediate points
1
0.50, 0.80)
Avg 0.1015
Document Level Averages
Recall p[OCRerr]recision
at 5 docs 0.0093 0.4720
at 15 docs 0.0291 0.4787
at 30 docs 0.0570 0.4713
at 100 docs 0.1474 0.4084
at 200 docs 0.2184 0.3168
Precision
0.4
0.2 -
0
A
0 0.2 0.4 0.6 0.
ROC Averages Recall
False Alarm Detection
0.00000 0.0557
0.00001 0.0844
0.00002 0.1084
0.00003 0.1237
0.00004 0.1388
0.00005 0.1495
0.00006 0.1599
0.00007 0.1687
0.00008 0.1768
0.00009 0.1844
NORMAL DEVIATE - Detection-False Alarm
I I
0.5 0.84 0.98 0
0.001 0.02
3
0.16
y
2
1
½
0
-1
-2 -w
.3 I __________________
-3 -2 -1 0 2