SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Lilts - New York University Summary Statistics Run number nyuir2-category B, automatic Num[OCRerr]queries 25 1[OCRerr]'otai- number of documents over all queries Retrieved 4990 Relevant 3318 Rel[OCRerr]et 958 [OCRerr]all Level Averages Precision 0.7168 0.4858 0.3722 0.2032 p 0.1382 p 0.0599 p 0.0419 0.0058 0.0030 0.0000 0.0000 eprecision for all points Lvg 0.1843 e precision for 3 [OCRerr]iate points .50, 0.80) vg 0.1450 Document Level Averages ____________ Recall Precision at 5 docs 0.0444 0.5200 at 15 docs 0.0929 0.4267 at 30 docs 0.1424 0.3627 at 100 docs 0.2550 0.2684 at 200 docs 0.3466 0.1916 ROC Averages False Alarm Detection 0.00000 0.0754 0.00001 0.0983 0.00002 0.1269 0.00003 0.1227 0.00004 0.1305 0.00005 0.1531 0.00006 0.1639 0.00007 0.1668 0.00008 0.1717 0.00009 0.1549 Recall-Precision Curve 1 0.8 0.6 - Precision 0.4 0.2 0 A 0 0.2 0.4 0.6 0.8 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 0.16 3 2 1 0 -i -1 -2 ( 5 0.84 0.98 0 C ½<½ -3 ½[OCRerr] -3 -2 -1 0 2 3