SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman results - Rutgers University Summary Statistics Run Number rutcombx-full, manual Num of Queries 50 Total number of documents over all queries Retrieved: 49983 Relevant: 10489 Rel[OCRerr]ret: 6244 Recall Level Averages Recall Precision 0.00 0.7739 0.10 0.5601 0.20 0.4537 0.30 0.4042 0.40 0.3458 0.50 0.2860 0.60 0.2074 0.70 0.1708 0.80 0.1180 0.90 0.0668 1.00 0.0132 erage precision over all 1 evant docs n-interpolated 0.2905 )ut Level Averages out Recall 000 0.3188 020 0.3966 040 0.4374 060 0.4733 080 0.4980 100 0.5403 120 0.5587 140 0.5765 160 0.5927 [OCRerr]180 0.6044 `200 0.6169 Document Level Averages Precision At 5 docs 0.6000 At 10 docs 0.5640 At 15 docs 0.5427 At 20 docs 0.5300 At 30 docs 0.5000 At 100 docs 0.3880 At 200 docs 0.3023 At 500 docs 0.1930 At 1000 docs 0.1249 1 0.8< 0.6 Precision 0.4 0.2 0 R-Precision (precision a+ter R 1 (where R is docs retrieved the number of ments)) relevant docu- 0.8 0.6 Exact 0.3375 NORMAL DEVIATE - Fallout-Recall Recall Recall-Precision Curve 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve 0.98 0. 0.4 2 0.98 0.2 1 0.84 0 0.5 0 0 0.05 0.1 0.15 0.2 -1 0.16 Fallout x 100 -2 0.02 -3 I I 0.001 -3 -2 -1 0 1 2 3