SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman `suits - New York University Summary Statistics Run number nyuirl-category B, automatic 1 Num[OCRerr]queries 25 Total number of documents over all queries Retrieved 5000 0.8 Relevant 3766 Rel[OCRerr]et 834 0.6, Precision [OCRerr]call Level Averages Document Level Averages all Precision Recall Precision 0.4 0 0.5691 at 5 docs 0.0338 0.3360 0 0.3618 at 15 docs 0.0671 0.2960 0.2 0 0.1846 at 30 docs 0.0979 0.2787 0 0.1314 at 100 docs 0.2117 0.2276 0 0.1065 at 200 docs 0.2988 0.1668 0 0 0.0481 ROC Averages 0 0.0295 False Alarm Detection 0 0.0104 0.00000 0.0397 0 0.0104 0.00001 0.0537 0 0.0000 0.00002 0.0666 0 0.0000 0.00003 0.0698 ge precision for all points 0.00004 0.0762 Avg 0.1320 0.00005 0.0801 ge precision for 3 0.00006 0.0872 riediate points 0.00007 0.0899 0.50, 0.80) 0.00008 0.0963 [OCRerr]vg 0.0811 0.00009 0.1008 Recall-Precision Curve 0 0.2 0.4 0.6 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 0.16 3 2 1 0 I I -1 -2 C 0.84 0.98 0. y -3 I I I -3 -2 -1 0 1 2