SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Lilts - Carnegie Mellon University [ Summ&y Statistics Run number clart[OCRerr]full, manual 1 Recall-Precision Curve Num4ueries 50 J 1 t Total number of documents over all queries I Retrieved 10000 1 0.8 Relevant 16400 Rel[OCRerr]ret 3409 [OCRerr]all Level Averages 11 Precision 0.9010 0.5497 0.3609 0.1997 0.1304 0.0514 0.0423 0.0169 0.0000 0.0000 0.0000 precision for all points vg 0.2048 precision for 3 diate points *!50[OCRerr]0.80)0.1374 ] I 0.6 Document Level Averages Precision ____________ Recall Precision 0.4 at 5 docs 0.0179 0.7560 at 15 docs 0.0455 0.6533 at 30 docs 0.0804 0.6020 0.2 at 100 docs 0.1834 0.4570 at 200 docs 0.2567 0.3409 0 0 0.2 0.4 ROC Averages False Alarm Detection 0.00000 0.0976 0.00001 0.1235 0.00002 0.1471 0.00003 0.1655 0-00004 0.1772 0.00005 0.1868 0.00006 0.1964 0.00007 0.2063 0.00008 0.2136 0.00009 0.2220 Recall 0.6 0.8 NORMAL DEVIATE - Detection-False Alarm a [OCRerr]. I I I I 0. [OCRerr]O1 3 2 1 0 -1 -2 .3 0.02 0.16 5 0.84 0.98 0.99 ( C 0 3 -2 -1 0 2 3