SP500215
NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2)
Appendix A: TREC-2 Results
Appendix
National Institute of Standards and Technology
D. K. Harman
suits - PRC, Inc.
Summary Statistics
Run Number prceo2-full, manual Recall-Precision Curve
Num of Queries 50 1
L
lotal number of documents over all queries
Retrieved: 50000 0.8
Relevant: 10785
Rel[OCRerr]ret: 3561
F
0.6
[OCRerr]ecall Level_Averages
Recall Precision
0.00 0.4768
0.10 0.2613
0.20 0.1807
0.30 0.1202
0.40 0.0875
0.50 0.0504
0.60 0.0328
0.70 0.0169
0.80 0.0142
0.90 0.0077
1.00 0.0031
age precision over all
ant docs
nterpolated 0.0904
Document Level Averages
Precision
At 5 docs 0.2120
At 10 docs 0.2480
At 15 docs 0.2707
At 20 docs 0.2760
At 30 docs 0.2753
At 100 docs 0.2418
At 200 docs 0.1756
At 500 docs 0.1086
At 1000 docs 0.0712
R-Precision (precision after R
docs retrieved (where R is
the number of relevant docu-
ments))
Exact 0.1703
Precision
0.4
0.2
0
Level Averages NORMAL DEVIATE - [OCRerr]11out-Reca11
t Recall Recall
101 0.02 0.16 5 a84 0.98 0
0 0.1861
0 0.2402
0 0.2860
0 0.3141
0 0.3387
0 0.3564
0 0.3623
0 0.3623
0 0.3623
0 0.3623
0 0.3623
2 0.98
1
0.8
0.6
0.4
0.21
1 0.84
0 0.5 0
0 0.2 0.4 0.6 0.8
Recall
Fallout-Recall Curve
I I
I I
0 0.05 0.1 0.15 0.2
-1 0.16
Fallout x 100
-2 0.02
-3 0.001
-3 -2 -1 0 1 2 3