SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Lits - CITRI, Royal Melbourne Institute of Technology [ Summ&y Statistics 1 Run number citri2-full, automatic 1 Num[OCRerr]queries 50 Total number of documents over all queries Retrieved 10000 Relevant 16400 Rel[OCRerr]ret 2348 [OCRerr]all Level Averages 11 Precision F- 0.6496 0.3515 0.1189 0.0460 0.0274 ) 0.0081 ) 0.0075 ) 0.0000 ) 0.0000 ) 0.0000 ) 0.0000 [OCRerr]e precision for all points[OCRerr] [OCRerr]vg 0.1099 ] [OCRerr] precision for 3 iediate points 0.50, 0.80) [OCRerr]vg 0.0423 Document Level Averages Recall Precision at 5 docs 0.0102 0.4440 at 15 docs 0.0280 0.4293 at 30 docs 0.0483 0.3900 at 100 docs 0.1165 0.3198 at 200 docs 0.1668 0.2348 ROC Averages False Alarm Detection 0.00000 0.0404 0.00001 0.0559 0.00002 0.0686 0.00003 0.0810 0.00004 0.0899 0.00005 0.0979 0.00006 0.1056 0.00007 0.1137 0.00008 0.1192 0.00009 0.1239 0.8 - 0.6 Precision 0.4 0.2 0 Recall- Precision Curve 0 0.2 0.4 0.6 Recall NORMAL DEVIATE - Detection-False Alarm 0.16 0 0.84 0.98 0. 0 t I I I I 0. Ol 0.02 3 2 1 0 -1 -2 -3 -3 -2 -1 0 1 2