SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Lits - Queens College, CUNY L Summary Statistics 1 F Run number pircs2[OCRerr]ategory B, manual Num[OCRerr]queries 25 Total number of documents over all queries Retrieved 5000 0.8[OCRerr] Relevant 3318 Rel[OCRerr]ret 1414 0.6 Recall-Precision Curve call Level Averages 11 Precision 0.7998 0.6742 0.5626 0.4322 I 0.3106 I 0.2783 0.2037 0.1580 0.0681 0.0396 p 0.0133 e precision for all points [OCRerr]vg 0.3219 ;e precision for 3 [OCRerr]diate points ).50, 0.80) vg 0.3030 Document Level Averages Precision ____________ Recall Precision 0.4 at 5 docs 0.0665 0.6320 at 15 docs 0.1340 0.5307 0.2 - at 30 docs 0.2156 0.4787 at 100 docs 0.4245 0.3680 at 200 docs 0.5876 0.2828 0 ROC Averages Recall False Alarm Detection 0.00000 0.1084 0.00001 0.1273 0.00002 0.1565 0.00003 0.1829 0.00004 0.2107 0.00005 0.2313 0.00006 0.2436 0.00007 0.2574 0.00008 0.2840 0.00009 0.2969 0 0.2 0.4 0.6 0.8 NORMAL DEVIATE - Detection-False Alarm o ol 0.02 3 2 1 0 .1 -2 -3 0.16 C 5 0.84 0.98 0.9 .0 . I I ________I -3 -2 -1 0 1 2 3