SP500215 Appendix A: TREC-2 Results Appendix National Institute of Standards and Technology D. K. Harman `esults - Swiss Federal Institute of Technology (ETH) [ Summary Statistics I I Run Number schaul-full, automatic 1 L Num of Queries 50 Total number of documents over all queries 1 Retrieved: 50000 1 Relevant: 10489 Reljet: 5345 j Recall Level Averages Recall Precision 0.00 0.5925 0.10 0.4192 0.20 0.3618 0.30 0.3083 0.40 0.2453 0.50 0.1982 0.60 0.1319 0.10 0.0824 0.80 0.0485 0.90 0.0165 1.00 0.0023 `rage precision over all vant docs i-interpolated 0.1994 ut Level Averages [OCRerr]t Recall [OCRerr] 0.2488 120 0.3126 140 0.3618 160 0.4031 )80 0.4549 LOO 0.4855 L20 0.5102 L40 0.5341 L60 0.5501 L80 0.5684 ?00 0.5811 Document Level Averages Precision At 5 docs 0.4000 At 10 docs 0.3960 At 15 docs 0.3680 At 20 docs 0.3550 At 30 docs 0.3500 At 100 docs 0.2910 At 200 docs 0.2350 At 500 docs 0.1561 At 1000 docs 0.1069 R-Precision (precision after R docs retrieved (where R is the number of relevant docu- ments)) 1 0.8 0.6 Precision 0.4 0.2 0 Fxact 0.2108 NORMAL DEVIATE - Fallout-Recall Recall 0.02 0.16 C 5 1 0.8 0.6 0.84 0.98 0 0.4 0.2 2 0.98 Recall-Precision Curve 0 0.2 0.4 0.6 0.8 Recall Fallout-Recall Curve 1 0.84 0 0.5 0 0 0.05 0.1 0.15 0.2 -1 0.16 Falloutx 100 -2 0.02 -3 I I I I 0.001 -3 -2 -1 0 1 2 3