SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman results - TRW Systems and Development Division Summary Statistics Run Number trwl-full, manual 1 Recall-Precision Curve Num of Queries 50 1 Total number of documents over all queries Retrieved: 36485 0.8 Relevant: 10489 Rel[OCRerr]ret: 5681 0.6 - [OCRerr]ecall Level Averages Recall Precision 0.00 0.1181 0.10 0.4823 0.20 0.4319 0.30 0.3706 0.40 0.3093 0.50 0.2586 0.60 0.1878 0.70 0.1471 0.80 0.1094 0.90 0.0528 1.00 0.0113 age precision over all ant docs interpolated 0.2525 Document Level Averages ________________ Precision At 5 docs 0.4640 At 10 docs 0.4100 At 15 docs 0.4507 At 20 docs 0.4300 At 30 docs 0.4247 At 100 docs 0.3770 At 200 docs 0.2929 At 500 docs 0.1847 At 1000 docs 0.1136 R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) Exact 0.3220 Precision 0.4 0.2 0 1 0.8 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve I I I I 0.6 L Level Averages NORMAL DEVIATE - Fallout-Recall t Recall 0.3071 0 0.4006 *0 0.4389 0 0.4745 0 0.5004 0 0.5218 0 0.5389 0 0.5507 0 0.5614 0 0.5685 0 0.5743 g) 101 0.02 0.98 0 )[OCRerr]999 2 0.98 Recall 0.4 0.2 - 1 0.84 0 0.5 0 0 0.05 0.1 0.15 0.2 -1 0.16 Fallout x 100 -2 0.02 -3 0.001 -3 -2 -1 0 1 2 3