SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Lts - Queens College, CUNY Summary Statistics Run number pircs1[OCRerr]ategory B, automatic 1 1 N um[OCRerr]queries 23 Total number of documents over all queries 0.8 Retrieved 4370 Relevant 3238 Rel[OCRerr]ret 1237 0.6 Precision call Level Averages Document Level Averages 0.4 1 Precision Recall Precision 0.7481 at 5 docs 0.0321 0.4522 0.5259 at 15 docs 0.0938 0.4928 0.2 0.4328 at 30 docs 0.1649 0.4507 0.3071 at 100 docs 0.3595 0.3570 0.2707 at 200 docs 0.5018 0.2689 0 0.2173 ROC Averages 0.1333 False Alarm Detection 0.0105 0.00000 0.0454 0.0000 0.00001 0.0505 0.0000 0.00002 0.1007 0.0000 0.00003 0.1111 e[OCRerr]ecision for all points 1 0.00004 0.1418 Lvg 0.2405 J 0.00005 0.1588 e precision for 3 0.00006 0.1771 Ajate points 0.00007 0.1890 0.00008 0.1797 0.00009 0.2151 1 .50, 0.80) vg 0.2167 Recall-Precision Curve 0 0.2 0.4 0.6 0.8 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 3 0.16 0.5 0.84 0.98 0.99 2 ½½' 1 0 -1 -2 w--4, -3 I I I I -3 -2 -1 0 2 3