SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Lilts - Conquest Software, Inc. Summ&y Statistics Run number CnQstl-full, automatic I Num4ueries 50 Total number of documents over all queries Retrieved 10000 Relevant 16400 Rel[OCRerr]ret 2779 [OCRerr]call Level Averages all Precision 0.6593 LO 0.3368 0.2395 0.0984 0.0862 50 0.0720 60 0.0568 70 0.0331 80 0.0164 90 [OCRerr]079 00 0.0000 `age precision for all points t Avg 0.1461 age precision for 3 mediate points [),0.50, 0.80) Avg 0.1093 Document Level Averages Recall Precision at 5 docs 0.0097 0.4160 at 15 docs 0.0276 0.3907 at 30 docs 0.0531 0.3800 at 100 docs 0.1467 0.3408 at 200 docs 0.2232 0.2779 ROC Averages False Alarm Detection 0.00000 0.0364 0.00001 0.0682 0.00002 0.0901 0.00003 0.1097 0.00004 0.1270 0.00005 0.1398 0.00006 0.1506 0.00007 0.1641 0.00008 0.1723 0.00009 0.1801 Recall[OCRerr]Precision Curve 1 0.8 0.6 Precision 0.4 0.2 0 0 0.2 0.4 0.6 0. Recall 0.001 0.02 0.16 0.5 0.84 0.98 C 3 2 1 0 1 -2 NORMAL DEVIATE - Detection-False Alarm -3 3 -2 -1 0 1 2