SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman [OCRerr]ults - Carnegie Mellon University Summary Statistics Run number clartb-full, manual Num[OCRerr]queries 50 Total number of documents over all queries Retrieved 10000 Relevant 15459 Rel[OCRerr]ret 3427 `call Level Averages Precision 0.7479 0.5245 0.3443 0.2125 0.0680 0.0259 0.0000 0.0000 0.0000 0.0000 0.0000 e[OCRerr]precision for all points vg 0.1748 e precision for 3 `diate points .50, 0.80) vg 0.1234 Document Level Averages Recall Precision at 5 docs 0.0110 0.5120 at 15 docs 0.0360 0.5320 at 30 docs 0.0675 0.5140 at 100 docs 0.1778 0.4560 at 200 docs 0.2521 0.3427 ROC Averages False Alarm Detection 0.00000 0.0717 0.00001 0.0990 0.00002 0.1251 0.00003 0.1450 0.00004 0.1617 0.00005 0.1747 0.00006 0.1863 0.00007 0.1981 0.00008 0.2052 0.00009 0.2132 Recall- Precision Curve 1 0.8 0.6 - Precision 0.4 0.2 I I A A 0 0 0.2 0.4 0.6 0.8 Recall NORMAL DEVIATE - Detection-False Alarm Ol 0.02 0.16 3. 5 0.84 0.98 0 3 ½<½ 2 1 0 -1 -2 -3 1711 -3 -2 -1 0 2 3