SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman esults - TRW Systems and Development Division L L Summary Statistics Run Number trw2-full, manual Num of Queries 50 Total number of documents over all queries Retrieved: 48432 Relevant: 10489 Rel[OCRerr]ret: 7383 [OCRerr]ecall Level Averages Recall Precision 0.00 0.8320 0.10 0.6329 0.20 0.5431 0.30 0.4694 0.40 0.4096 0.50 0.3558 0.60 0.2848 0.70 0.2132 0.80 0.1499 0.90 0.0899 1.00 0.0210 rage precision over all [OCRerr]ant docs -interpolated 0.3459 it Level Averages ut Recall 00 0.3768 20 0.4753 2 40 0.5289 `60 0.5694 1 `80 0.6029 0 .00 0.6321 .20 0.6599 -1 .40 0.6770 .60 0.6930 -2 .80 0.7035 -3 !00 0.7147 Document Level Averages Precision At 5 docs 0.6680 At 10 docs 0.6240 At 15 docs 0.6107 At 20 docs 0.5810 At 30 docs 0.5453 At 100 docs 0.4554 At 200 docs 0.3623 At 500 docs 0.2350 At 1000 docs 0.1477 R-Precision (precision after R (where R is relevant docu- docs retrieved the number of ments)) [OCRerr]t03807 NORMAL DEVIATE - Fallout-Recall Recall 0.84 0.98. - 0 -3 -2 -1 0 1 2 3 Recall-Precision Curve 1 0.8< 0.6 Precision 0.4 0.2 I I 0 0 0.2 0.4 0.6 0.8 1 Recall Fallout-Recall Curve 1 0.8 0.6 - 0.4< 0.98 0.2 0.84 0.5 0 0 0.05 0.1 0.15 0.2 0.16 Fallout x 100 0.02 0.001