SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman [OCRerr]sults - Rutgers University Summary Statistics Run Number rutfmed-full, partial topics, manual Recall-Precision Curve Num of Queries 25 1 Total number of documents over all queries Retrieved: 24001 0.8 Relevant: 4119 Rel[OCRerr]ret: 2314 Recall Level_Averages Recall Precision 0.00 0.6054 0.10 0.4215 0.20 0.3574 0.30 0.2726 0.40 0.2152 0.50 0.1459 0.60 0.1067 0.70 0.0753 0.80 0.0496 0.90 0.0204 1.00 0.0000 `rage precision over all vant docs -interpolated 0.1852 Document Level Averages Precision At 5 docs 0.3920 At 10 docs 0.3880 At 15 docs 0.3787 At 20 docs 0.3860 At 30 docs 0.3733 At 100 docs 0.2892 At 200 docs 0.2256 At 500 docs 0.1418 At 1000 docs 0.0926 R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) Exact 0.2464 0.6 Precision 0.4 0.2 0 1 0.8 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve I I I it Level Averages ut Recall [OCRerr] 0.3238 20 0.4356 40 0.4861 60 0.5370 80 0.5625 00 0.5863 20 0.5933 40 0.5933 60 0.5933 80 0.5933 00 0.5933 NORMAL DEVIATE - Fallout-Recall 0.6 Recall )01 0.02 0.98 0 0.4 0.2 - 2 0.98 1 0.84 0 0.5 0 0 0.05 0.1 0.15 0.2 -1 0.16 Fallout x 100 -2 0.02 -3 0.001 -3 -2 -1 0 1 2 3