SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman [OCRerr]u1ts Conquest Software, Inc. Summary Statistics [ Run number CnQst2-full, manual Num[OCRerr]queries 50 1 { Total number of documents over all queries Retrieved 10000 0.8[OCRerr] Relevant 16400 Rel[OCRerr]ret 3700 0.6 Lecall Level Averages Document Level Averages Precision all Precision Recall Precision 0.4 0.8047 at 5 docs 0.0126 0.5520 0 0.5346 at 15 docs 0.0410 0.5653 0 0.3268 at 30 docs 0.0733 0.5267 0.2 0 0.2078 at 100 docs 0.2041 0.4730 0 0.1621 at 200 docs 0.2960 0.3700 0 0 0.1192 0 0.0812 ROC Averages 0 0.0644 False Alarm Detection 0 0.0216 0.00000 0.0787 () 0.0187 0.00001 0.1148 ____ 0.0000 0.00002 0.1500 0.00003 0.1740 [OCRerr] precision for all points 1 0.00004 0.1949 [OCRerr]vg 0.2128 0.00005 0.2086 [OCRerr]e precision for 3 0.00006 0.2222 ediate points 0.00007 0.2375 0.50, 0.80) 0.00008 0.2490 Lvg 0.1559 0.00009 0.2571 Recall-Precision Curve 0 0.2 0.4 0.6 Recall NORMAL DEVIATE - Detection-False Alarm 3 2 0 -1 -2 `01 0.02 0.16 ( -- 1 5 0.84 0.98 0.[OCRerr] ½<½ -3 I I I -3 -2 -1 0 2 3