SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman [OCRerr]ults - OCLC Online Computer Library Center, Inc. L L Summary Statistics number Num~queries50 Total number of documents over all queries Retrieved 10000 Relevant 2172 Rel[OCRerr]et 1274 Lecall Level Averages all Precision 0 0.5744 0 0.4535 0 0.3841 0 0.3443 0 0.2679 0 0.2202 () 0.1561 [) 0.1083 [) 0.0623 [) 0.0231 ) 0.0114 1,e precision for all points [OCRerr]vg 0.2369 v,e precision for 3 ediate points [).50, 0.80) vg 0.2222 Document Level Averages Recall Precision at 5 docs 0.0726 0.3600 at 15 docs 0.1514 0.3093 at 30 docs 0.2541 0.2753 at 100 docs 0.4897 0.2018 at 200 docs 0.5930 0.1274 ROC Averages False Alarm Detection 0.00000 0.0479 0.00001 0.0538 0.00002 0.0907 0.00003 0.0909 0.00004 0.1104 0.00005 0.1161 0.00006 0.1313 0.00007 0.1315 0.00008 0.1327 0.00009 0.1419 Recall-Precision Curve 1 0.8 - 0.6 Precision 0.4 0.2 - I I 0 0 0.2 0.4 0.6 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 3 2 0 -1 0.16 0.5 0.84 0.98 0.9 ½<½ -2 [OCRerr]_ -3I -3 -2 -1 0 2 3