SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman ;u'ts - Beilcore [ Summ&y Statistics Run number IsiazO 1-full, automatic Recall-Precision Curve Num[OCRerr]queries 50 1 Total number of documents over all queries Retrieved 9993 0.8 - Relevant 16400 Rel[OCRerr]ret 2469 0.6 [OCRerr]call Level Averages all Precision 0 0.6448 0 0.3367 .0 0.1510 0 0.0524 :0 0.0248 0 0.0000 0 0.0000 `0 0.0000 .0 0.0000 0 0.0000 `0 0.0000 ge precision for all points Avg 0.1100 j ge precision for 3 [OCRerr]ediate points 0.50, 0.80) [OCRerr]vg 0.0503 Document Level Averages Precision Recall Precision 0.4 at 5 docs 0.0085 0.4320 at 15 docs 0.0229 0.3840 0.2 at 30 docs 0.0391 0.3473 at 100 docs 0.1063 0.3010 at 200 docs 0.1745 0.2469 0 A A 0 0.2 0.4 0.6 0. ROC Averages False Alarm Detection 0.00000 0.0311 0.00001 0.0438 0.00002 0.0581 0.00003 0.0683 0.00004 0.0809 0.00005 0.0908 0.00006 0.0983 0.00007 0.1055 0.00008 0.1139 0.00009 0.1242 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 3 2 1 0 -1 -2 0.16 0.5 0.84 0.98 0. 7 ½ -3 I I I -3 -2 -1 0 1 2