SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
suits - GE Research and Development Center
Summary Statistics
Run number gecrdl-full, manual 1
Num[OCRerr]queries 50
Total number of documents over all queries
0.8
Retrieved 6911
Relevant 15459
Rel[OCRerr]ret 3308 0.6
Precision
ecall Level Averages Document Level Averages
tll Precision _____________ Recall Precision 0.4
() 0.8044 at 5 docs 0.0133 0.6080
() 0.5286 at 15 docs 0.0359 0.5840 0.2
0 0.3427 at 30 docs 0.0720 0.5747
() 0.2006 at 100 docs 0.1713 0.4486
0 0.0703 at 200 docs 0.2377 0.3308 0
0 0.0275
ROC Averages
0 0.0171
False Alarm Detection
0 0.0000
0.00000 0.0674
0 0.0000
0.00001 0.1082
0 0.0000
0.00002 0.1394
0 0.0000
0.00003 0.1558
ge precision for all points 0.00004 0.1720
Avg 0.1810 0.00005 0.1859
ge precision for 3 0.00006 0.1912
[OCRerr]ediate points 0.00007 0.1976
0.50, 0.80) 0.00008 0.2040
[OCRerr]vg 0.1234 0.00009 0.2105
Recall-Precision Curve
¼--- A
0 0.2 0.4 0.6
Recall
NORMAL DEVIATE - Detection-False Alarin
0.001 0.02
3 I I
0.16 0.5 0.84 0.98 0
2
½½'
1
0
-1
-[OCRerr]
-2
-3II
-3 -2 -1 0 2