SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman suits - Rut[OCRerr]ers University Summary Statistics Run Number rutcombx-full, partial topics, manual 1 Num of Queries 25 Total number of documents over all queries Retrieved: 25000 Relevant: 4119 Rel[OCRerr]ret: 2378 [OCRerr]ecall Level_Averages Recall Precision 0.00 0.1145 0.10 0.4611 0.20 0.3894 0.30 0.3325 0.40 0.2841 0.50 0.2001 0.60 0.1502 0.10 0.1057 0.80 0.0101 0.90 0.0345 1.00 0.0104 rage precision over all [OCRerr]ant docs -interpolated 0.2284 it Level Averages [OCRerr]t Recall DO 0.3413 20 0.4453 40 0.5131 60 0.5584 80 0.5901 DO 0.6090 20 0.6202 40 0.6202 60 0.6202 80 0.6202 DO 0.6202 Document Level Averages Precision At 5 docs 0.4120 At 10 docs 0.4600 At 15 docs 0.4640 At 20 docs 0.4520 At 30 docs 0.4280 At 100 docs 0.3396 At 200 docs 0.2432 At 500 docs 0.1489 At 1000 docs 0.0951 R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) Exact 0.2185 NORMAL DEVIATE - Fallout-Recall )01 0.02 0.84 0.98 0 0.4 0.2 2 0.98 1 0.84 0 0.5 0 Recall-Precision Curve 1 0.8 - 0.6 - Precision 0.4 0.2 I I I I 0 1 0.8 0.6 Recall 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve I I I I I I 0 0.05 0.1 0.15 0.2 -1 0.16 Fallout x 100 -2 0.02 -3 I I I 0.001 -3 -2 -1 0 1 2 3