SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
Lilts - GE Research and Development Center
I Summary Statistics
Run number gecrdl-full, manual 1
Num[OCRerr]queries 50
Total number of documents over all queries
Retrieved 7365
Relevant 16400
Rel[OCRerr]ret 3363
Precision
ecall Level Averages Document Level Averages
Precision Recall Precision 0.4
0 0.8682 at 5 docs 0.0164 0.6640
0 0.5258 at 15 docs 0.0413 0.6107 0.2
0 0.3154 at 30 docs 0.0725 0.5593
0 0.1562 at 100 docs 0.1813 0.4508
0 0.1196 at 200 docs 0.2452 0.3363 0
0 0.0522 ROC Averages
0 0.0395 False Alarm Detection
0 0.0112
0.00000 0.0824
0 0.0000
0.00001 0.1065
0 0.0000
0.00002 0.1352
0 0.0000
0.00003 0.1554
,[OCRerr]ecision for all points 1 0.00004 0.1698
Avg 0.1898 0.00005 0.1831
ge precision for 3 0.00006 0.1933
[OCRerr]diate points 0.00007 0.2002
0.50, 0.80) 0.00008 0.2089
[OCRerr]vg 0.1226 0.00009 0.2166
]
0.8
1 0.6
Recall-Precision Curve
0 0.2 0.4 0.6 0.
Recall
NORMAL DEVIATE - Detection-False Alarm
0.001 0.02 0.16 0.5
3
2
1
0
-1
0.84 0.98 0.
<½'
-77
-2
-3 I I I I
.3 -2 -1 0 1 2