SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman suits University of Central Florida I [ Summary Statistics Run number UCFQA1-category B, automatic Recall-Precision Curve Num[OCRerr]queries 25 1 Total number of documents over all queries Retrieved 5000 0.8 Relevant 3766 Rel[OCRerr]et 704 0.6 [OCRerr]all Level Averages 11 Precision 0.5248 0.2190 0.1293 0.0689 p 0.0389 p 0.0069 0.0000 p 0.0000 I 0.0000 0.0000 p 0.0000 ;e precision for all points] [OCRerr]vg 0.0898 ,e precision for 3 diate points [OCRerr].50, 0.80) vg 0.0454 Document Level Averages Precision Recall Precision 0.4 at 5 docs 0.0116 0.2560 at 15 docs 0.0328 0.2080 0.2 at 30 docs 0.0559 0.1933 at 100 docs 0.1661 0.1860 A A at 200 docs 0.2446 0.1408 0 0 0.2 0.4 0.6 0.8 ROC Averages False Alarm Detection 0.00000 0.0138 0.00001 0.0223 0.00002 0.0261 0.00003 0.0282 0.00004 0.0324 0.00005 0.0367 0.00006 0.0453 0.00007 0.0433. 0.00008 0.0500 0.00009 0.0518 Recall NORMAL DEVIA[OCRerr]E Detection-False Alarm 0 p01 3 2 1 0 -1 -2 -3 .0 _________________ 0.02 0.16 C 5 0.84 0.98 0. -3 -2 -1 0 2 3