SP500215
NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2)
Appendix A: TREC-2 Results
Appendix
National Institute of Standards and Technology
D. K. Harman
,ults - Cornell University
Summary Statistics
Run Number crnlL2-full, automatic 1
Num of Queries 50
Total number of documents over all queries
Retrieved: 50000
Relevant: 10785
Rel[OCRerr]ret: 8224
ecall Level_Averages
Recall Precision
0.00 0.7756
0.10 0.5381
0.20 0.4732
0.30 0.4321
0.40 0.3959
0.50 0.3585
0.60 0.2991
0.70 0.2357
0.80 0.1705
0.90 0.0904
1.00 0.0148
age precision over all
ant docs
interpolated 0.3258
Level Averages
t Recall
Po 0.4533
0 0.5983
*0 0.6796
10 0.7287
0 0.7634
0 0.7838
.0 0.7864
0 0.7864
10 0.7864
0 0.7864
0 0.7864
Document Level Averages
Precision
At 5 docs 0.5640
At 10 docs 0.5460
At 15 docs 0.5373
At 20 docs 0.5210
At 30 docs 0.4933
At 100 docs 0.4406
At 200 docs 0.3852
At 500 docs 0.2600
At 1000 docs 0.1645
R[OCRerr]Precision (precision after R
docs retrieved (where R is
the number of relevant docu-
ments))
Exact 0.3641
NORMAL DEVIATE - Fallout-Recall
Ol 0.02 0.98 0 0.4
0.2
2 0.98
1 0.84
0 0.5 0
Recall-Precision Curve
1
0.8,
0.6
Precision
0.4
0.2
I I
0
1
0.8
0.6
Recall
0 0.2 0.4 0.6 0.8 1
Recall
Fallout-Recall Curve
I I I
0 0.05 0.1 0.15 0.2
-1 0.16 Fallout x 100
-2 0.02
-3 0.001
-3 -2 -1 0 1 2 3