<DOC>
<DOCNO> SP500215 </DOCNO>
<TITLE> NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2) </TITLE>
<SUBTITLE> Appendix A: TREC-2 Results </SUBTITLE>
<TYPE> Appendix </TYPE>
<PAGE CHAPTER="A" NUMBER="79">
<AUTHOR1> </AUTHOR1>
<PUBLISHER> National Institute of Standards and Technology </PUBLISHER>
<EDITOR1> D. K. Harman </EDITOR1>
<COPYRIGHT MTH="March" DAY="" YEAR="1994" BY="National Institute of Standards and Technology">
</COPYRIGHT>
<BODY>
esults - Queens College, CUNY
Summary Statistics ]
[ Run Number pircs2-full, automatic 1
L Num of Queries 501
Total number of documents over all queries
0.8 -
Retrieved: 50000
Relevant: 10489
Rel[OCRerr]ret: 6135 0.6
Recall- Precision Curve
[OCRerr]ecall Level Averages
Recall Precision
0.00 0.6609
0.10 0.4959
0.20 0.4145
0.30 0.3735
0.40 0.3219
0.50 0.2638
0.60 0.2046
0.70 0.1586
0.80 0.1199
0.90 0.0656
1.00 0.0085
rage precision over all
[OCRerr]ant docs
-interpolated 0.2664 1
it Level Averages
ut Recall
31
[OCRerr] 0.3010
`20 0.3821 2
`40 0.4263
60 0.4648 1
80 0.4954
0
.00 0.5175
.20 0.5603 -1
.40 0.5795
.60 0.5958 -2
.80 0.6056
-3
[OCRerr]0 0.6155
Document Level Averages Precision
Precision 0.4
At 5 docs 0.5440
At 10 docs 0.5120
0.2
At 15 docs 0.4907
At 20 docs 0.4690 0 0.2 0.4 0.6 0.81
At 30 docs 0.4460 0
At 100 docs 0.3588
At 200 docs 0.2895 Recall
At 500 docs 0.1901
At 1000 docs 0.1227
Fallout-Recall Curve
R-Precision (precision after R 1
(where R is
of relevant docu-
docs retrieved
the number
ments))
Exact 0.3155
NORMAL DEVIATE - Fallout-Recall
.001 0.02 0.16 0.5 0.84 0.98 0.[OCRerr]
4-4[OCRerr]r
I I I
[OCRerr]7--
-3 -2 -1 0 2 3
Recall
I[OCRerr]999
0.8
0.6 -
0.4
0.98
0.2
0.84
0.5 0
0 0.05 0.1 0.15 0.2
0.16 Fallout x 100
0.02
0.001
</BODY>
</PAGE>
</DOC>