SP500207 Appendix B: TIPSTER Panel Results appendix National Institute of Standards and Technology Donna K. Harman `its - HNC, Inc. [ Summary Statistics Run number HNCmn1[OCRerr]isk1 only, manual 1 Num[OCRerr]queries 50 Total number of documents over all queries Retrieved 9982 0.8 - Relevant 10477 Rel[OCRerr]et 2711 0.6 Recall-Precision Curve [OCRerr]all Level Averages Precision 0.6569 0.4078 0.3005 0.2331 0.1540 0.0952 0.0338 0.0169 0.0101 0.0020 0.0020 r,e precision for all points [OCRerr]vg 0.1739 v,e precision for 3 ediate points [).50, 0.80) Lvg 0.1352 Precision Document Level Averages Recall Precision 0.4 at 5 docs 0.0184 0.4400 at 15 docs 0.0469 0.4227 0.2 at 30 docs 0.0758 0.3847 at 100 docs 0.2098 0.3388 at 200 docs 0.3209 0.2711 0 0 0.2 0.4 0.6 0.8 ROC Averages Recall False Alarm Detection 0.00000 0.0726 0.00001 0.0967 0.00002 0.1039 0.00003 0.1287 0.00004 0.1301 0.00005 0.1518 0.00006 0.1677 0.00007 0.1837 0.00008 0.1857 0.00009 0.1995 NORMAL DEVIATE - Detection-False Alarm C I I 0 i01 3 2 1 0 -1 -2 .3 0.02 0.16 0.5 0.84 0.98 0 -3 -2 -1 0 1 2 3