SP500207 Appendix B: TIPSTER Panel Results appendix National Institute of Standards and Technology Donna K. Harman results - University of Massachusetts at Amherst [ Summary Statistics Run number I NQ RYC-full, manual L Num[OCRerr]queries 50 1 Total number of documents over all queries 1 Retrieved 10000 1 0.8 Relevant 15459 *Rel[OCRerr]ret 4527 j 0.6 Recall Level Averages call Precision 00 0.8688 10 0.6770 20 0.5321 30 0.3515 40 0.1606 50 0.0703 60 0.0342 70 0.0000 80 0.0000 90 0.0000 90 0.0000 age precision for all points Avg 0.2449 ] age precision for 3 [OCRerr]ediate points 0.50, 0.80) Avg 0.2008 Document Level_Averages Precision Recall Precision 0.4 at 5 docs 0.0202 0.7080 at 15 docs 0.0542 0.6893 0.2 at 30 docs 0.0947 0.6493 at 100 docs 0.2268 0.5478 at 200 docs 0.3457 0.4527 0 ROC Averages False Alarm Detection 0.00000 0.1161 0.00001 0.1544 0 0.00002 0.1833 3 0.00003 0.2082 0.00004 0.2262 2 0.00005 0.2414 0.00006 0.2537 1 0.00007 0.2670 0.00008 0.2797 0 0.00009 0.2899 -1 -2 -3 Recall-Precision Curve 0 0.2 0.4 0.6 0 Recall NORMAL DEVIATE - Detection-False Alarm .001 0.02 0.16 0.5 0.84 0.98 I I I I -3 -2 -1 0 1 2