SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman ilts - New York University I Summ&y Statistics Run number nyuir1[OCRerr]ategory B, 1 Num[OCRerr]quenes automat2i5c I Total number of documents over all queries Retrieved 4986 0.8 Relevant 3318 Rel[OCRerr]et 1161 0.6 [OCRerr]all Level Averages .11 Precision 0.7830 0.6216 0.4891 0.3815 0.2350 0.1871 0.1447 p 0.0705 0.0229 0.0000 ____ 0.0000 [OCRerr]recision for all points [OCRerr]vg 0.2669 [OCRerr] precision for 3 ediate points [OCRerr].50, 0.80) 0.2330 Document Level Averages Precision Recall Precision 0.4 at 5 docs 0.0713 0.5680 at 15 docs 0.1326 0.5200 0.2 at 30 docs 0.1868 0.4320 at 100 docs 0.3350 0.3140 at 200 docs 0.4294 0.2322 0 Recall-Precision Curve 0 0.2 0.4 0.6 0.8 ROC Averages Recall False Alarm Detection 0.00000 0.1363 NORMAL DEVIATE - Detection-False Alarm 0.00001 0.1770 0.001 0.02 0.16 ( 5 0.84 0.98 0 C 0.00002 0.1698 3 0.00003 0.2026 ½<½ 0.00004 0.1911 2 0.00005 0.2292 0.00006 0.2109 1 0.00007 0.2149 0.00008 0.2491 0 0.00009 0.2578 -1 -2 -3 W½ I I -3 .2 -1 0 2 3