SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman ults - Mead Data Central, Inc. Summary Statistics Run Number UREKA2-full, manual 1 Num of Queries 50 Total number of documents over all queries Retrieved: 50042 Relevant: 10785 Rel[OCRerr]ret: 2690 ecall Level Averages Recall Precision 0.00 0.2740 0.10 0.0977 0.20 0.0774 0.30 0.0701 0.40 0.0617 0.50 0.0467 0.60 0.0338 0.70 0.0242 0.80 0.0187 0.90 0.0000 1.00 0.0000 rage precisior[OCRerr] over all `-[OCRerr]rtteidp0:l:ted0.05021 it Level Averages ut Recall 00 0.0733 20 0.1100 2 40 0.1403 [OCRerr]0 0.1713 1 80 0.1970 0 .00 0.2173 .20 0.2271 -1 .40 0.2271 .60 0.2271 -2 .80 0.2271 -3 ?00 0.2271 Document Level Averages Precision At 5 docs 0.1360 At 10 docs 0.1140 At 15 docs 0.1067 At 20 docs 0.1100 At 30 docs 0.1033 At 100 docs 0.0912 At 200 docs 0.0831 At 500 docs 0.0664 At 1000 docs 0.0538 R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) Exact 0.0793 NORMAL DEVIATE - Fallout-Recall Recall 5 C ). .-- . .9 I I 101 0.02 0.84 0.98 0. 0.98 0.84 0.16 -3 -2 -1 0 2 3 Recall-Precision Curve 1 0.8 0.6 Precision 0.4 0.2 I I 0 0 0.2 0.4 0.6 0.8 1 Recall Fallout-Recall Curve 1 I I 0.8 0.6 0.4 0.2 0.5 0 0 0.05 0.1 0.15 0.2 0.16 Fallout x 100 0.02 0.001