SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
ults - GTE Laboratories
number f
Num[OCRerr]queries50j 1
Total number of documents over all queries
Retrieved 10000
0.8 -
Relevant 4056
t Rel[OCRerr]et 1561
0.6
ecall Level Averages Document Level Averages Precision
Precision Recall Precision 0.4
0.6492 at 5 docs 0.0769 0.4040
0.4468 at 15 docs 0.1282 0.3387
0.3278 at 30 docs 0.1764 0.2887 0.2
0.2484 at 100 docs 0.3653 0.2252
0.1916 at 200 docs 0.4633 0.1561 0
0.1455
0.1159 ROC Averages
0.0963 False Alarm Detection
0.0474 0.00000 0.0472
0.0166 0.00001 0.0570
0.0055 0.00002 0.0821
0.00003 0.1110
for all points
0.00004 0.1185
vg~~83
0.00005 0.1454
precision
0.00006 0.1332
diate points 0.00007 0.1446
0.00008 0.1704
ig[OCRerr]0.[OCRerr] 0.00009 0.1598
Recall-Precision Curve
0 0.2 0.4 0.6 0.8
Recall
NORMAL DEVIATE - Detection-False Alarm
0.001 0.02 0.16 0.5 0.54 0.98 0.9[OCRerr]
3
2
1
0
-1
½<½
-2
-3
½w< II
-3 -2 -1 0 1 2 3
C
C
0