SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman slilts - Conquest Software, Inc. Summary Statistics ] Run Number CnQst2-full, manual 1 Num of Queries 50 J Total number of documents over all queries 1 Retrieved: 50000 1 Relevant: 10785 Rel[OCRerr]ret: 6788 [OCRerr]ecall Level Averages Recall Precision 0.00 0.7202 0.10 0.5005 0.20 0.4411 0.30 0.3787 0.40 0.3242 0.50 0.2681 0.60 0.2010 0.70 0.1373 0.80 0.0947 0.90 0.0465 1.00 0.0045 [OCRerr]age precision over all 1 ,ant docs interpolated 0.2633 t Level Averages it Recall Po 0.3737 ?0 0.4851 [OCRerr] 0.5676 )0 0.6290 30 0.6653 )0 0.6931 [OCRerr]0 0.6960 [OCRerr] 0.6960 )0 0.6960 10 0.6960 [OCRerr]0 0.6960 Document Level Averages Precision At 5 docs 0.5080 At 10 docs 0.4880 At 15 docs 0.4920 At 20 docs 0.4960 At 30 docs 0.4793 At 100 docs 0.4178 At 200 docs 0.3256 At 500 docs 0.2102 At 1000 docs 0.1358 R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) Exact 0.3140 NORMAL DEVIATE - Fallout-Recall g) Ol 0.02 2 0.98 Recall-Precision Curve 1 0.8 0.6 Precision 0.4 0.2 0 I I I Recall 1 0.8 0.6 0.4 0.2 1 0.84 0 0.5 0 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve I I I I I I 0 0.05 0.1 0.15 0.2 -1 0.16 Fallout x 100 -2 0.02 -3 0.001 -3 -2 -1 0 1 2 3