SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman `sults - Queens College, CUNY Summary Statistics Recall-Precision Curve Run number pircsl-category B, automatic 1 Num[OCRerr]queries 25 Total number of documents over all queries Retrieved g 5000 0.8 Relevant 3766 Rel[OCRerr]ret 1471 0.6 Precision [OCRerr]call Level Averages Document Level Averages Precision Recall Precision 0.4 0 0.7918 at 5 docs 0.0475 0.6080 0 0.6256 at 15 docs 0.1448 0.5973 0.2 0 0.5378 at 30 docs 0.2280 0.5213 0 0.4373 at 100 docs 0.4434 0.3980 0 0.3648 at 200 docs 0.5764 0.2942 0 0 0.2 0.4 0.6 0. 0 0.3395 Recall ROC Averages 0 0.2814 False Alarm Detection 0 0.1627 NORMAL DEVIATB - Detection-False Alarm 0.00000 0.0974 0 0.1132 0.00001 0.1370 0.001 0.02 0.16 ( 5 0.84 0.98 0. 0 0.0804 3 0.00002 0.1767 0 0.0391 0.00003 0.1966 ge precision for all points 1 0.00004 0.2096 2 Avg 0.3430 0.00005 0.2426 y `ge precision for 3 0.00006 0.2476 1 [OCRerr]ediate points 0.00007 0.2694 0.50, 0.80) 0.00008 0.2910 0 [OCRerr]vg 0.3302 0.00009 0.2947 -1 -2 -3 I I I -3 -2 -1 0 2