SP500207 Appendix B: TIPSTER Panel Results appendix National Institute of Standards and Technology Donna K. Harman ults - University of Massachusetts at Amherst Summary Statistics Run number INQRYO-full, manual I Num[OCRerr]queries 50 Total number of documents over all queries Retrieved 10000 0.8 Relevant 16400 Rel[OCRerr]ret 4503 0.6 [OCRerr]call Level Averages Precision 0 0.9448 0 0.6794 0 0.5250 0 0.3067 0 0.1668 0 0.1116 0 0.0926 0 0.0631 0 0.0337 0 0.0174 0 0.0000 ge precision for all points Avg 0.2674 J ge precision for 3 iediate points 0.50, 0.80) [OCRerr]vg 0.2235 Document Level Averages Precision Recall Precision 0.4 at 5 docs 0.0184 0.7640 at 15 docs 0.0549 0.7293 0.2 at 30 docs 0.0992 0.6840 at 100 docs 0.2451 0.5546 at 200 docs 0.3572 0.4503 0 Recall- Precision Curve 0 0.2 0.4 0.6 ROC Averages Recall False Alarm Detection 0.00000 0.1250 NORMAL DEVIATE - Detection-False Alarm 0.00001 0.1654 0.001 0.02 0.16 C 5 0.84 0.98 0 0.00002 0.1957 3 0.00003 0.2203 ½<½ 0.00004 0.2409 2 0.00005 0.2576 0.00006 0.2738 1 0.00007 0.2882 0.00008 0.2994 0 0.00009 0.3113 -1 -[OCRerr] -2 -3 __________________ I I -3 -2 -1 0 2