SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman ults - Cornell University Summary Statistics Run number crnlp2-full, automatic 1 Num[OCRerr]queries 50 Total number of documents over all queries Retrieved 10000 0.8 Relevant 16400 Rel[OCRerr]ret 3793 0.6 Lecall Level Averages all Precision 0 0.7803 0 0.5389 `0 0.3507 0 0.2134 :0 0.1366 0 0.0917 0 0.0724 0.0229 `0 0.0187 0 0.0098 0 0.0000 [OCRerr]e precision for all points Avg 0.2032 [OCRerr]e precision for 3 riediate points 0.50, 0.80) [OCRerr]vg 0.1537 Precision Document Level Averages Recall Precision 0.4 at 5 docs 0.0145 0.5560 at 15 docs 0.0412 0.5400 0.2 at 30 docs 0.0764 0.5187 at 100 docs 0.1931 0.4414 at 200 docs 0.3001 0.3793 0 Recall-Precision Curve 0 0.2 0.4 0.6 0. ROC Averages Recall False Alarm Detection 0.00000 0.0759 NORMAL DEVIATE - Detection-False Alarm 0.00001 0.1047 0.001 0.02 0.16 0.5 0.84 0.98 0. 0.00002 0.1335 3 0.00003 0.1528 0.00004 0.1727 0.00005 0.1893 ½½' 0.00006 0.2051 0.00007 0.2244 0.00008 0.2362 0 0.00009 0.2483 -1 -2 -3 [OCRerr]It -3 -2 -1 0 2