SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Its - University of Pittsburgh Summary Statistics Run number upitt3[OCRerr]disk2 only, automatic 1 Num4ueries 50 Total number of documents over all queries Retrieved 5383 0.8 Relevant 5923 Rel[OCRerr]et 1249 0.6 Precision `call Level Averages Document Level Averages [1 Precision ____________ Recall Precision 0.4 0.5622 at 5 docs 0.0192 0.3280 0.2723 at 15 docs 0.0509 0.2867 0.2 0.2025 at 30 docs 0.0849 0.2533 0.1382 at 100 docs 0.1753 0.1844 0.0708 at 200 docs 0.2206 0.1249 0 0.0309 ROC Averages 0.0279 False Alarm Detection 0.0155 0.00000 0.0303 0.0136 0.00001 0.0426 0.0000 0.00002 0.0582 0.0000 0.00003 0.0675 ;[OCRerr]ecision for all points 0.00004 0.0745 [OCRerr]vg 0.1213 0.00005 0.0819 ,`e precision for 3 0.00006 0.0881 [OCRerr]diate points 0.00007 0.0912 ).50, 0.80) 0.00008 0.0946 vg 0.0824 0.00009 0.1017 Recall-Precision Curve 0 0.2 0.4 0.6 0.8 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 0.16 3 2 1 0 -1 0.5 0.84 0.98 0.9[OCRerr]. ½½' -2 iw-. -3II -3 -2 -1 0 2 3