SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman ililts - University of California, Berkeley Summary Statistics Run Number Brkly3-full1 automatic 1 1 Num of Queries 50 Total number of documents over all queries Retrieved: 50000 0.8 Relevant: 10185 Rel[OCRerr]ret: 1166 0.6 Recall-Precision Curve ecall Level Averages Recall Precision 0.00 0.8461 0.10 0.5630 0.20 0.5016 0.30 0.4423 0.40 0.3946 0.50 0.3491 0.60 0.2963 0.10 0.2126 0.80 0.1490 0.90 0.0543 1.00 0 0040 age precision over all ant docs interpolated 0 3210 t Level Averages it Recall 70 0.4522 ?0 0.5186 10 0.6602 )0 0.1125 30 0.1411 )0 0.1611 ?0 0.1635 10 0.1635 ,0 0.1635 30 0.1635 )0. 0.1635 Document Level Averages Precision At S docs 0.6000 At 10 docs 0.5160 At 15 docs 0.5581 At 20 docs 0.5400 At 30 docs 0.5281 At 100 docs 0.4568 At 200 docs 0.3195 At 500 docs 0.2485 At 1000 docs 0.1553 R-Precision (precision after R docs retrieved (where R is the number of relevant docu- Precision 0.4 0.2 0 1 ments)) 0.8 Exact 0.3691 0.6 NORMAL DEVIATE - Fallout-Recall Recall Ol 0.02 0.84 0.98 0 0.4 2 0.98 0.2 1 0.84 0 0.5 0 I I I 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve I I I I I 0 0.05 0.1 0.15 0.2 -1 0.16 Fallout x 100 -2 0.02 -3 0.001 -3 -2 -1 0 1 2 3