SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Appendix A: TREC-1 Results
appendix
National Institute of Standards and Technology
Donna K. Harman
Its - Carnegie Mellon University
L Summary Statistics
Run number clarta-full, manual 1 1
Num[OCRerr]queries 50
Total number of documents over all queries 1
0.8
Retrieved 10000 1
Relevant 16400
Rel[OCRerr]ret 2110 J 0.6
Precision
[OCRerr]all Level Averages Document Level Averages
11 Precision Recall Precision 0.4
0.6138 at 5 docs 0.0084 0.3920
p 0.2634 at 15 docs 0.0219 0.3520 0.2
p 0.1445 at 30 docs 0.0420 0.3467
0.0810 at 100 docs 0.1051 0.2732
0.0479 at 200 does 0.1570 0.2110 0
0.0152
ROC Averages
0.0052
False Alarm Detection
0.0000
0.00000 0.0316
0.0000
0.00001 0.0460
0.0000
0.00002 0.0619
____ 0.0000
0.00003 0.0736
r,[OCRerr]ecision for all points I
0.00004 0.0810
[OCRerr]vg 0.1065 0.00005 0.0901
`,e precision for 3 0.00006 0.0975
ediate points 0.00007 0.1068
0.50, 0.80) 0.00008 0.1133
Lvg 0.0533 0.00009 0.1201
Recall-Precision Curve
0 0.2 0.4 0.6 0.8
Recall
NORMAL DEVIATE - Detection-False Alarm
U
I I
0. Ol 0.02
3
2
1
0
-1
-2
-3
0.16 0.5 0.84 0.98 0.9
-3 -2 -1 0 2 *[OCRerr]