SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman `esults - The Environment Research Institute of Michigan Summary Statistics Run Number erimr2-full, automatic 1 Num of Queries 50 Total number of documents over all queries Retrieved: 45274 0.8 - Relevant: 10489 Rel[OCRerr]ret: 4475 0.6 Recall-Precision Curve Recall Level Averages Recall Precision 0.00 0.6448 0.10 0.3426 0.20 0.2643 0.30 0.2098 0.40 0.1551 0.50 0.1116 0.60 0.0568 0.70 0.0300 0.80 0.0168 0.90 0.0074 1.00 0.0006 `rage precision over all vant docs -interpolated 0.1415 Jt Level Averages ut Recall [OCRerr] 0.1891 20 0.2408 [OCRerr]0 0.2940 60 0.3245 [OCRerr]0 0.3517 .00 0.3797 .20 0.3958 .40 0.4092 .60 0.4219 .80 0.4343 [OCRerr]00 0.4445 Document Level Averages Precision At 5 docs 0.4720 At 10 docs 0.4240 At 15 docs 0.3933 At 20 docs 0.3810 At 30 docs 0.3420 At 100 docs 0.2524 At 200 docs 0.2012 At 500 docs 0.1394 At 1000 docs 0.0895 R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) Precision 0.4 0.2 0 1 0.8 Exact 6[OCRerr]2031 NORMAL DEVIATE - Fallout-Recall Recall 0 0.2 0.4 0.6 08 Recall Fallout-Recall Curve 0.6 - Ol 0.02 0.16 1 5 0.84 0.98 0. 0.4 2 0.98 0.2 1 0.84 I I 0 0.5 0 0 0.05 0.1 0.15 0.2 -1 0.16 Fallout x 100 -2 0.02 -3 0.001 -3 -2 -1 0 1 2 3