SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Lilts University of California, Berkeley Summary Statistics Run number Brkly2-full, automatic I Num[OCRerr]queries 50 Total number of documents over all queries Retrieved 10000 Relevant 16400 Rel[OCRerr]ret 3394 ecall Level Averages Precision 0 0.7093 0 0.4362 0 0.2583 0 0.1333 0 0.0754 0 0.0408 0 0.0045 0 0.0000 0 0.0000 0 0.0000 0 0.0000 ge precision for all points Avg 0.1507 ] `ge precision for 3 [OCRerr]ediate points ½\ 0.50, 0.80) [OCRerr]vg 0.0997 0.8 - 0.6 Precision 0.4 0.2 0 Document Level Averages Recall Precision at 5 docs 0.0091 0.4400 at 15 docs 0.0288 0.4573 at 30 docs 0.0545 0.4533 at 100 docs 0.1592 0.4080 at 200 docs 0.2550 0.3394 ROC Averages False Alarm Detection 0.00000 0.0403 0.00001 0.0664 0.00002 0.0894 0.00003 0.1064 0.00004 0.1281 0.00005 0.1418 0.00006 0.1568 0.00007 0.1717 0.00008 0.1824 0.00009 0.1938 Recall-Precision Curve A 0 0.2 0.4 0.6 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 0.16 0.5 0.84 0.98 0. 3 2 1 0 -1 -2 -3 7 -[OCRerr] -3 -2 -1 0 2