SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman hsults - TRW Systems and Development Division Summary Statistics Run number trwl-full, manual 1 Num[OCRerr]queries 50 Total number of documents over[OCRerr]all queries Retrieved 6830 0.8 Relevant 15459 Rel[OCRerr]ret 3206 0.6 Precision Lecall Level Averages Document Level Averages all Precision ____________ Recall Precision 0.4 `0 0.8281 at 5 docs 0.0174 0.6160 0 0.5248 at 15 docs 0.0388 0.5547 0.2 0 0.3157 at 30 docs 0.0720 0.5453 `0 0.1816 at 100 docs 0.1678 0.4294 :0 0.0764 at 200 docs 0.2332 0.3206 0 0 0.0474 ROC Averages i'0 0.0198 False Alarm Detection `0 0.0000 0.00000 0.0762 `0 0.0000 0.00001 0.1095 0 0.0000 0.00002 0.1364 0 0.0000 0.00003 0.1504 Lge precision for all p0 0.00004 0.1661 Avg 0.1813 ints] 0.00005 0.1783 Lge precision for 3 0.00006 0.1863 riediate points 0.00007 0.1960 0.50, 0.80) 0.00008 0.2010 Avg 0.1210 0.00009 0.2045 Recall-Precision Curve 0 0.2 0.4 0.6 0. Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 3 2 1 0 -1 -2 .3 I I 0.16 C 0.84 0.98 0. y -w I I I I .3 -2 -1 0 2