SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman [OCRerr]su1ts - Systems Environment Corporation Summary Statistics Run Number SEC-category B, automatic Num of Queries 50 ] 1 Total number of documents over all queries Retrieved: 19602 0.8 Relevant: 2064 Rel[OCRerr]ret: 37 Recall-Precision Curve `call Level_Averages Recall Precision 0.00 0.0213 0.10 0.0000 0.20 Q.0000 0.30 0.0000 0.40 0.0000 0.50 0.0000 0.60 0.0000 0.70 0.0000 0.80 0.0000 0.90 0.0000 1.00 0.0000 precision over all terpolateci~005J Level Averages Recall 0.0030 0.0046 0.0056 0.0057 0.0073 0.0080 0.0069 0.0071 0.0076 0.0080 0.0082 Document Level Averages Precision At 5 docs 0.0040 At 10 docs 0.0020 At 15 docs 0.0027 At 20 docs 0.0050 At 30 docs 0.0060 At 100 docs 0.0038 At 200 docs 0.0025 At 500 docs 0.0015 At 1000 docs 0.0007 { R- Precision (pThecisionafterR docs retrieved (where R is he number of relevant docu- j Exact 0.0042 [OCRerr] NORMAL DEVIATE - Fallout-Recall )01 0.02 0.16 .5 0.84 0.98 0 2 0.98 1 0.84 0 0.5 -1 0.16 -2 0.02 -3 0.001 -3 -2 -1 0 1 2 3 0.6 Precision 0.4 0.2 0< A A 0 0.2 0.4 0.6 0.8 1 Recall Recall Fallout-Recall Curve 1 0.8 0.6 0.4 0.2 0 0 0.05 0.1 0.15 0.2 Fallout x 100