SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman suits - Queens College, CUNY Summary Statistics Run number pircs2-category B, 1 Num[OCRerr]queries manu2al] Total number of documents over all queries Retrieved 5000 0.8 Relevant 3766 Rel[OCRerr]ret 1539 0.6 [OCRerr]call Level Averages il Precision 0.8428 0.6482 0.5581 0.4842 0.4171 0.3422 0.3079 0.2008 0.1220 0.0905 0.0404 [OCRerr]r[OCRerr]ecision for all points [OCRerr]vg 0.3686 r,e precision for 3 ediate points ).50, 0.80) .vg 0.3408 Document Level_Averages Precision Recall Precision 0.4 at 5 docs 0.0476 0.6400 at 15 docs 0.1408 0.6053 0.2 at 30 docs 0.2352 0.5400 at 100 docs 0.4649 0.4236 at 200 docs 0.5878 0.3078 0 Recall-Precision Curve 0 0.2 0.4 0.6 0.8 ROC Averages Recall False Alarm Detection 0.00000 0.1106 NORMAL DEVIATE - Detection-False Alarm 0.00001 0.1384 0.001 0.02 0.16 0.5 0.84 0.98 0 0.00002 0.1974 3 0.00003 0.1914 0.00004 0.2318 2 0.00005 0.2701 0.00006 0.2985 0.00007 0.3051. 0.00008 0.3175 ½ 0 0.00009 0.3184 -1 -2 -3 I I I -3 -2 -1 0 1 2 3