SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman r[OCRerr]q.iiltq. - Advanced Decision Systems Summary Statistics maPonlYautomatioc Total number of documents over all queries Retrieved 40423 Relevant: 5677 Rel[OCRerr]ret: 822 Document Level Averages Precision At 5 docs 0.0560 At 10 docs 0.0480 At 15 docs 0.0573 At 20 docs 0.0640 At 30 docs 0.0687 At 100 docs 0.0468 At 200 docs 0.0336 At 500 docs 0.0239 At 1000 docs 0.0164 R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) Exact 0.0390 Run Number Num of Queries Recall Level Averages Recall Precision 0.00 0.1620 0.10 0.0542 0.20 0.0468 0.30 0.0273 0.40 0.0201 0.50 0.0056 0.60 0.0056 0.70 0.0000 0.80 0.0000 0.90 0.0000 1.00 0.0000 [OCRerr]erage precision over all levant docs )n-interpolated 0.0195 Precision iout Level Averages NORMAL DEVIATE - Fallout-Recall Recall lout Recall ooi 0.02 0.16 0.5 0.84 0.98 0.9[OCRerr]999 0000 0.0236 0020 0.0311 2 0.98 0040 0.0346 0060 0.0389 1 0.84 0080 0.0429 0 0.5 `0100 0.0457 0120 0.0476 -1 0.16 0140 0.0497 )0160 0.0526 -2 0.02 )0180 0.0539 -3 0.001 )0200 0.0553 -3 -2 -1 0 1 2 3 Recall-Precision Curve 1 0.8 0.6 0.4 0.2 0 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve 1 0.8 - 0.6 0.4 0.2 0< 0 0.05 0.15 0.1 Fallout x 100 0.2