SP500215
NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2)
Appendix A: TREC-2 Results
Appendix
National Institute of Standards and Technology
D. K. Harman
suits - University of Illinois at Chicago
Summary Statistics
Run Number uicah-full, automatic 1 Recall-Precision Curve
Num of Queries 50 J 1
Total number of documents over all queries 1
Retrieved: 45108 1 0.8
Relevant: 10785
Rel[OCRerr]ret: 4421
0.6
[OCRerr]ecall Level Averages
Recall Precision
0.00 0.5665
0.10 0.3272
0.20 0.2527
0.30 0.1937
0.40 0.1413
0.50 0.0712
0.60 0.0393
0.70 0.0069
0.80 0.0000
0.90 0.0000
1.00 0.0000
age precision over all 1
ant docs
interpola~~.1200
Level Averages
t
~0
0
0
0
0
0
0
0
0
0
0
Recall
0.2095
0.3057
0.3532
0.3860
0.4125
0.4359
0.4467
0.4467
0.4467
0.4467
0.4467
Document Level Averages
Precision
At 5 docs 0.3280
At 10 docs 0.3340
At 15 docs 0.3280
At 20 docs 0.3380
At 30 docs 0.3233
At 100 docs 0.2784
At 200 docs 0.2107
At 500 docs 0.1392
At 1000 docs 0.0884
R-Precision (precision after R
docs retrieved (where R is
the number of relevant docu-
ments))
Exact I 0.1950
NORMAL DEVIATE - Fallout-Recall
Precision
0.4
0.2
0
1
0.8
0.6
Recall
)01 0.02 0.84 0.98 0
0.4 -
0.2
2 0.98
1 0.84
0 0.5 0
0 0.05 0.1 0.15 0.2
-1 0.16 Fallout x 100
-2 0.02
-3
0.001
-3 -2 -1 0 1 3
0 0.2 0.4 0.6 0.8
Recall
Fallout-Recall Curve
I I
A