SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman tilts - Siemens Corporate Researchq Inc. [ Summary Statistics Run Number siems2-fuIl, automatic Num of Queries 50 Total number of documents over all queries Retrieved: 50000 Relevant: 10785 Rel[OCRerr]ret: 8068 `call Level_Averages Recall Precision 0.00 0.1964 0.10 0.5166 0.20 0.5267 0.30 0.4808 0.40 0.4244 0.50 0.3810 0.60 0.3088 0.70 0.2418 0.80 0.1416 0.90 0.0513 1.00 0.0000 ige precision over all mt docs riterpolated 0.3408 Document Level Averages Precision At 5 docs 0.6000 At 10 docs 0.5860 At 15 docs 0.5733 At 20 docs 0.5600 At 30 docs 0.5447 At 100 docs 0.4690 At 200 docs 0.4030 At 500 docs 0.2606 At 1000 docs 0.1614 R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) Fxact 0.3938 Level Averages NORMAL DEVIATE - Fallout-Recall Recall ) 0.7722 ) 0.7163 ) 0.7763 ) 0.7763 ) 0.7763 Ol 0.02 0.16 0.4 0.2 2 0.98 1 0.84 0 0.5 0 Recall-Precision Curve 1 0.8 0.6 Precision 0.4 0.2 I I 0 1 0.8 0.6 Recall 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve I I I I 0 0.05 0.1 0.15 0.2 -1 0.16 Fallout x 100 -2 0.02 -3 -3 -2 -1 0 2 3 0.001