SP500215
NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2)
Combination of Multiple Searches
chapter
E. Fox
J. Shaw
National Institute of Standards and Technology
D. K. Harman
Table 9: Average Precision and Exact R-Precision for the five individual runs compared with the combined CombSUM
runs (Routing Topics 51-100).
Average non-interpolated Precision
[Run [[ AP-3 [OCRerr] PATN-3 SJM-3 ZF-3 II Disk 3
sV 0.1347 0.0189 0.1139 0.0593 0.0589
LV 0.1189 0.0156 0.1056 0.0587 0.0494
Pnl.0 0.2519 0.0257 0.2128 0.1141 0.2039
Pnl.5 0.2869 0.0239 0.2411 0.1189 0.2279
Pn2.0 0.2852 0.0221 0.2390 0.1303 0.2225
CombSUM 0.3196 0.0260 0.2696 0.1304 0.2681
Chg/Max 11.4% 1.2% 11.8% 0.07% 17.6%
_________ Exact_R-Precision _______ _______
[Run [[ AP-3 [OCRerr] PATN-3 [OCRerr] SJM-3 ] ZF-3 II Disk 3 ]
sV 0.1703 0.0171 0.1337 0.0595 0.0595
LV 0.1444 0.0156 0.1098 0.0547 0.1002
Pnl.0 0.2790 0.0325 0.2185 0.1224 0.2594
Pnl.5 0.3082 0.0322 0.2579 0.1248 0.2786
Pn2.0 0.3062 0.0310 0.2531 0.1462 0.2809
CombSUM 0.3319 0.0319 0.2900 0.1260 0.3143
Chg/Max 7.7% -1.8% 12.4% -13.8% 11.9%
Table 10: Average Precision and Exact R-Precision for the five individual runs (Ad-hoc Topics 101-150).
Average non-interpolated Precision
Run I'__AP__]_DOE_[OCRerr] Disk 1 _______ ______ fi_______ Disk 2 ZF [OCRerr] oth
FR ] WSJ J ZF `1 AP ] FR [OCRerr] WSJ [ `[Disks J
sV 0.3237 0.0949 0.0630 0.2740 0.0936 0.3068 0.0650 0.2259 0.1166 0.2035
LV 0.3326 0.0697 0.1018 0.2848 0.0997 0.2981 0.0602 0.2483 0.1045 0.2159
Pnl.0 0.3340 0.0831 0.1777 0.3153 0.1292 0.3133 0.1927 0.2838 0.1722 0.2205
Pnl.5 0.3682 0.0814 0.1874 0.3332 0.1430 0.3438 0.1982 0.2941 0.1964 0.2543
Pn2.0 0.3647 0.0750 0.1761 0.3290 0.1307 0.3419 0.1995 0.2828 0.2018 0.2573
CombSUM 0.4153 0.1038 0.2133 0.3778 0.1657 0.3959 0.2000 0.3561 0.2200 0.3206
Chg/Max 12.8% 9.4% 13.8% 13.4% 15.9% 15.1% 0.2% 21.0% 9% 24.6%
_____________________ Exact R-Precision
_______ FR [OCRerr] wSJ [ TI 1
[Run I{ 0A33P51 J DOE [Disk 1 [OCRerr] [OCRerr] J ZF [OCRerr] AP ] Disk 2 ZF [OCRerr] DBio$i[OCRerr] [OCRerr]
sV 0.0947 0.0567 0.2881 0.1086 0.3052 0.0718 0.2502 0.1130 0.2649
LV 0.3385 0.0714 0.1006 0.3022 0.1055 0.3019 0.0540 0.2712 0.1036 0.2661
Pnl.0 0.3495 0.0989 0.1434 0.3322 0.1190 0.3139 0.1653 0.2934 0.1577 0.2867
Pnl.5 0.3721 0.0899 0.1582 0.3440 0.1277 0.3465 0.1716 0.3044 0.1796 0.3203
Pn2.0 0.3735 0.0925 0.1579 0.3389 0.1154 0.3401 0.1640 0.2953 0.1979 0.3233
CombSUM 0.4137 0.1156 0.1938 0.3757 0.1389 0.3712 0.1741 0.3385 0.1909 0.3711
Chg/Max 10.8% 16.9% 22.5% 9.2% 8.8% 7.1% 1.4% 11.2% -3.5% 14.8%
250