SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman `suits - City University, London L Summary Statistics Run number cityri-full, automatic Recall-Precision Curve Num[OCRerr]queries 50 1 L J 4'otal number of documents over all queries Retrieved 10000 0.8 - Relevant 15459 L Rel[OCRerr]ret 3286 ¼\ 0.6 ecall Level Averages Document Level Averages Precision 11 Precision Recall Precision 0.4 0.7676 at 5 docs 0.0113 0.5480 0.5016 at 15 docs 0.0352 0.5453 0.2853 0.2 at 30 docs 0.0646 0.5093 0.1646 at 100 docs 0.1653 0.4376 0.0522 at 200 docs 0.2391 0.3286 0 0.0105 p 0.0045 ROC Averages 0.0000 False Alarm Detection 0.0000 0.00000 0.0607 0.0000 0.00001 0.0857 0.0000 0.00002 0.1103 0.00003 0.1268 e precision for all points] 0.00004 0.1422 Lvg 0.1624 ] 0.00005 0.1547 e precision for 3 0.00006 0.1655 `diate points 0.00007 0.1752 0.00008 0.1834 } 0.00009 0.1911 `.50, 0.80) vg 0.0986 0 0.2 0.4 0.6 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 0.16 3 0 -1 5 0.84 0[OCRerr]98 0.9 -2 -3 W½11 -3 -2 -1 0 2 3