SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman ults - University of Pittsburgh L Summary Statistics Run number upitt3-full, automatic 1 1 Num4ueries 50 Total number of documents over all queries 0.8 Retrieved 7611 Relevant 15459 Rel[OCRerr]ret 1277 0.6 call Level Averages 1 Precision 0.5285 0.1806 0.0511 0.0000 0.0000 0.0000 0.0000 p 0.0000 0.0000 0.0000 0.0000 r[OCRerr]ecision for all points [OCRerr]vg 0.0691 ] [OCRerr] precision for 3 ediate points [).50, 0.80) Lvg 0.0170 Precision Document Level Averages 0.4 Recall Precision at 5 docs 0.0074 0.3520 at 15 docs 0.0179 0.3013 0.2 at 30 docs 0.0307 0.2727 at 100 docs 0.0737 0.2102 0 at 200 docs 0.0889 0.1277 Recall-Precision Curve 0 0.2 0.4 0.6 0.8 ROC Averages Recall False Marm Detection 0.00000 0.0261 0.00001 0.0331 0.00002 0.0392 0.00003 0.0436 0.00004 0.0492 0.00005 0.0540 0.00006 0.0600 0.00007 0.0635 0.00008 0.0673 0.00009 0.0710 NORMAL DEVIATE - Detection-False Alarm 0. U ol 0.02 3 2 0 -1 -2 0.16 0.5 I - ½½' 0.84 0.98 0.91 ½ 7 .3 -2 -1 0 2 [OCRerr] I t .3