SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman ;ults - Universitaet Dortmnnd Summary Statistics J Run number fuhra2-full, automatic 1 Num[OCRerr]queries 50 1 Total number of documents over all queries Retrieved 10000 0.8 Relevant 16400 Rel[OCRerr]ret 3553 0.6 [OCRerr]call Level Averages Document Level Averages Precision all Precision Recall Precision 0.4 0.7966 at 5 docs 0.0138 0.5800 0 0.4968 at 15 docs 0.0363 0.5173 0.2 0.3204 at 30 docs 0.0675 0.5127 0.1961 at 100 docs 0.1697 0.4232 0.1302 at 200 docs 0.2666 0.3553 0 0.0864 ROC Averages 0.0527 False Alarm Detection 0 0.0376 0.00000 0.0718 0 0.0128 0.00001 0.1040 0 0.0072 0.00002 0.1295 0 0.0000 0.00003 0.1460 Lge precision for all points 0.00004 0.1628 Avg 0.1943 I 0.00005 0.1768 [OCRerr]e precision for 3 0.00006 0.1895 riediate points 0.00007 0.2027 0.50, 0.80) 0.00008 0.2114 [OCRerr]vg 0.1399 0.00009 0.2214 Recall-Precision Curve 0 0.2 0.4 0.6 0. Recall 5 NORMAL DEVIATE - Detection-False Alarm Ol 0.02 0.16 ( 3 2 1 0 -1 -2 0.84 0.98 0. ½<½ -3 __________________ I I -3 -2 -1 0 2