SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman ults - The Environment Research Institute of Michigan I Summary Statistics Recall-Precision Curve [OCRerr] Run Number erima2-full, automatic 1 1 Num of Queries 50 Total number of documents over all queries 0.8 Retrieved: 47943 Relevant: 10785 Rel[OCRerr]ret: 5975 0.6 ecall Level_Averages Recall Precision 0.00 0.7096 0.10 0.4059 0.20 0.3287 0.30 0.2723 0.40 0.2276 0.50 0.1698 0.60 0.1302 0.70 0.0707 0.80 0.0480 0.90 0.0011 1.00 0.0000 rage precision over all 1 [OCRerr]ant docs -interpolated 0.1885 1 Document Level Averages Precision At 5 docs 0.4760 At 10 docs 0.4480 At 15 docs 0.4320 At 20 docs 0.4180 At 30 docs 0.3993 At 100 docs 0.3426 At 200 docs 0.2707 At 500 docs 0.1799 At 1000 docs 0.1195 [OCRerr]R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) Fxact 0.2494 Precision 0.4 0.2 - 0 1 0.8 0.6 it Level Averages NORMAL DEVIATE - Fallout-Recall Recall Tht Recall 0.98 0 0.4 00 0.2717 20 0.3824 40 0.4449 60 0.4979 80 0.5353 00 0.5611 20 0.5678 40 0.5678 60 0.5678 .80 0.5678 !00 0.5678 2 0.98 0.2 1 0.84 0 0.5 0 -1 0.16 -2 0.02 -3 -3 -2 -1 0 1 2 3 0.001 1 0Thy~~~~0.40.60.8 Recall Fallout-Recall Curve 0 0.05 0.1 0.15 0.2 Fallout x 100