SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman `ults - Carnegie Mellon University Summary Statistics Run number clarta-full, manual 1 Num[OCRerr]queries 50 Total number of documents over all queries 0.8 Retrieved I 10000 Relevant 15459 Rel[OCRerr]ret 2139 0.6 Precision [OCRerr]all Level Averages Document Level_Averages 11 Precision Recall Precision 0.4 0.4736 at 5 docs 0.0059 0.2560 p 0.2712 at 15 docs 0.0205 0.3120 0.2 0.1033 at 30 docs 0.0387 0.3173 0.0394 at 100 docs 0.1002 0.2756 0.0170 at 200 docs 0.1499 0.2139 0 0.0000 ROC Averages 0.0000 False Alarm Detection 0.0000 0.00000 0.0267 0.0000 0.00001 0.0391 p 0.0000 0.00002 0.0531 0.0000 0.00003 0.0620 precision for all points 0.00004 0.0733 [OCRerr]vg 0.0822 0.00005 0.0809 [OCRerr],e precision for 3 0.00006 0.0883 ediate points 0.00007 0.0969 0.50, 0.80) 0.00008 0.1036 [OCRerr]vg 0.0344 0.00009 0.1095 Recall-Precision Curve 0 0.2 0.4 0.6 0.8 Recall NORMAL DEVIATE- Detection-False Alarm 0. [OCRerr]1 0.02 3 2 1 0 -1 -2 -3 0.16 ( C ). I I 5 0.84 0.98 0.[OCRerr] -3 -2 -1 0 1 2