SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Lilts - City University, London Summary Statistics Run number citym2-full, feedback 1 Num[OCRerr]queries 50 Total number of documents over all queries Retrieved 10829 0.8 Relevant 16400 Rel[OCRerr]ret 3431 0.6 ecall Level Averages Document Level Averages Precision LIl Precision Recall Precision 0.4 [) 0.7569 at 5 docs 0.0126 0.5800 [) 0.5072 at 15 docs 0.0353 0.5333 0.2 () 0.3262 at 30 docs 0.0654 0.5193 0 0.1442 at 100 docs 0.1662 0.4304 0 0.1016 at 200 docs 0.2407 0.3300 0 0 0.0667 ROC Averages 0 0.0418 False Alarm Detection 0 0.0174 0.00000 0.0795 0 0.0170 0.00001 0.1028 0 0.0143 0.00002 0.1245 0 0.0000 0.00003 0.1377 ge precision for all points 0.00004 0.1556 Avg 0.1812 0.00005 0.1684 ge precision for 3 0.00006 0.1766 iediate points 0.00007 0.1878 0.50, 0.80) 0.00008 0.1954 [OCRerr]vg 0.1366 0.00009 0.2047 Recall-Precision Curve 0 0.2 0.4 0.6 Recall NORMAL DEVIATE - Detection-False Alarm o ol 0.02 3 2 1 0 -1 -2 -3 .0 _________________ 0.16 0.5 0.84 0.98 0.( -3 -2 -1 0 1 2