SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman [OCRerr]"1ts - Universitaet Dortmiind Summary Statistics ] Run Number dortl2-fu II, automatic of Queries 50 Total number Retrieved: 50000 Relevant: 10785 jRel[OCRerr]ret:7774 ecall Level_Averages Recall Precision 0.00 0.7324 0.10 0.5410 0.20 0.4939 0.30 0.4370 0.40 0.3850 0.50 0.3324 0.60 0.2821 0.70 0.2133 0.80 0.1340 0.90 0.0707 1.00 0.0063 ge precision over all 1 nt docs [OCRerr]terpolated 0.3151 ] Level Averages Recall 0.4380 0.5641 0.6401 0.6920 0.7313 0.7519 0.7557 0.7557 0.7557 0.7557 0.7557 Document Level Averages ________________ Precision At 5 docs 0.5120 At 10 docs 0.5280 At 15 docs 0.5213 At 20 docs 0.5210 At 30 docs 0.5120 At 100 docs 0.4562 At 200 docs 0.3781 At 500 docs 0.2439 At 1000 docs 0.1555 L R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) Exact 0.3604 NORMAL DEVIATE - Fallout-Recall Ol 0.02 0.84 0.98 Recall-Precision Curve 1 0.8 0.6 Precision 0.4 0.2 0 I I I Recall 1 0.8 0.6 0.4 2 0.98 0.2 1 0.84 0 0.5 0 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve I I I I -1 0 0.05 0.1 0.15 0.2 0.16 Fallout x 100 -2 -3 0.02 0.001 -3 -2 -1 0 1 2 3