SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman [OCRerr]su1ts - The Environment Research Institute of Michi[OCRerr]an Summary Statistics Run Number erimal-full1 automatic Num of Queries 50 J TOtd'l number of documents over all[OCRerr]queries Retrieved: 48809 Relevant: 10185 Rel[OCRerr]ret: 5349 Recall Level_Averages Recall Precision 0.00 0.6409 0.10 0.3564 0.20 0.2893 0.30 0.2251 0.40 0.1693 0.50 0.1332 0.60 0.0911 0.70 0.0610 0.80 0.0310 0.90 0.0048 1.00 0.0000 rage precision over all [OCRerr]ant docs -interpolated 0.1589 Document Level Averages Precision At 5 docs 0.4360 At 10 docs 0.3960 At 15 docs 0.3827 At 20 docs 0.3810 At 30 docs 0.3660 At 100 docs 0.3016 At 200 docs 0.2378 At 500 docs 0.1598 At 1000 docs 0.1070 R-Precision (precision after R docs retrieved (where R is relevant docu- the number of ments)) Exact 0.2179 Recall-Precision Curve 1 0.8 - 0.6 Precision 0.4 0.2 I I 0 1 0.8 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve I I it Level Averages Lit Recall DO 0.2423 20 0.3411 40 0.4053 60 0.4460 BO 0.4827 DO 0.5138 20 0.5221 40 0.5221 60 0.5221 BO 0.5221 [OCRerr]0 0.5221 0.6 NORMAL DEVIATE - Fallout-Recall )Oi 0.98 0 0.4 2 0.98 0.2 1 0.84 0 0.5 0 0 0.05 0.1 0.15 0.2 -1 0.16 Fallout x 100 -2 0.02 -3 0.001 Recall -3 -2 -1 0 1 2 3