SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman iults - Queens College, CUNY Summary Statistics ] Run number pircs4-category B, [OCRerr]Num[OCRerr]queries feedbac2k5 1 Total number of documents over all queries Retrieved 5230 0.8 Relevant 3318 Rel[OCRerr]et 1582 0.6 Document Level Averages Precision ecall Level Averages Recall Precision 0.4 Precision at 5 docs 0.0695 0.6240 0 0.8242 at 15 docs 0.1389 0.5707 () 0.6935 at 30 docs 0.2272 0.5187 0.2 () 0.6105 at 100 docs 0.4774 0.4152 [) 0.4726 at 200 docs 0.6339 0.3074 0 [) 0.3672 [) 0.3418 ROC Averages ) 0.2869 False Alarm Detection ) 0.1983 0.00000 0.1608 ) 0.1206 0.00002 0.2035 ) 0.0609 0.00004 0.2576 ____ 0.0207 0.00006 0.2715 0.00008 0.3202 [OCRerr] precision for all pointsl 0.00010 0.3380 [OCRerr]vg 0.3634 ] 0.00012 0.3645 [OCRerr]e precision for 3 0.00014 0.3857 ediate points 0.00016 0.3791 0.00018 0.4337 1 0.00020 0.4211 ).50, 0.80) .vg 0.3576 Recall-Precision Curve 0 0.2 0.4 0.6 0.8 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 0.16 ( 5 0.84 0.98 0.9 3 2 1 0 .1 -2 -3 7£ I I I -3 -2 -1 0 2 3