SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman ilts New York University Summary Statistics Run number nyuir3[OCRerr]ategory B, automatic 1 Num[OCRerr]queries 25 Total number of documents over all queries Retrieved 4989 0.8 Relevant 3318 Rel[OCRerr]et 1039 0.6 Precision ecall Level Averages Document Level Averages dl Precision Recall Precision 0.4 ) 0.7368 at 5 docs 0.0571 0.5360 ) 0.5592 at 15 docs 0.1297 0.4907 0.2 ) 0.4660 at 30 docs 0.1734 0.4147 ) 0.3235 at 100 docs 0.2918 0.2916 ) 0.2099 at 200 docs 0.3908 0.2078 0 ) 0.1385 ROC Averages [) 0.0801 False Alarm Detection [) 0.0560 0.00000 0.1289 0.0056 0.00001 0.1575 [) 0.0000 0.00002 0.1761 [) 0.0000 0.00003 0.1594 [OCRerr]e precision for all points [OCRerr] 0.00004 0.1880 Avg 0.23411 0.00005 0.1966 [OCRerr]e precision for 3 0.00006 0.2254 iediate points 0.00007 0.2033 0.50, 0.80) 0.00008 0.2169 [OCRerr]vg 0.2034 0.00009 0.2424 Recall-Precision Curve 0 0.2 0.4 0.6 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 0.16 ( 3 2 1 0 -1 ½½' 5 0.84 0.98 0.[OCRerr] -2 -[OCRerr] -3 I I I I -3 -2 -1 0 2