SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman suits - Advanced Decision Systems Summary Statistics Run number adsba2category B, automatic Num[OCRerr]queries 25 `total number of documents over all queries R[OCRerr]eved4712 Relevant 3766 Rel[OCRerr]et 559 `call Level Averages Precision 0.3378 0.1223 0.0661 0.0358 0.0338 0.0186 0.0116 0.0116 0.0000 0.0000 0.0000 precision for all points vg 0.0580 I precision for 3 diate points .50, 0.80) 0.0282 J ] 1 Document Level Averages _____________ Recall Precision at 5 docs 0.0075 0.1200 at 15 docs 0.0174 0.1173 at 30 docs 0.0367 0.1253 at 100 docs 0.0931 0.1084 at 200 docs 0.1778 0.1118 ROC Averages False Alarm Detection 0.00000 0.0086 0.00001 0.0102 0.00002 0.0174 0.00003 0.0181 0.00004 0.0238 0.00005 0.0258 0.00006 0.0277 0.00007 0.0193 0.00008 0.0261 0.00009 0.0326 Recall-Precision Curve 1 0.8 0.6 Precision 0.4 0.2 0 A 0 0.2 0.4 0.6 0.8 Recall NORMAL DEVIATE - Detection-False Alarm 0. [OCRerr]1 0.02 0.16 3 2 1 0 C C 0.5 0.84 -1 0.98 0 [OCRerr]9 -2 C -3 C -3 -2 -1 0 1 2 3