SP500215
NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2)
UCLA-Okapi at TREC-2: Query Expansion Experiments
chapter
E. Efthimiadis
P. Biron
National Institute of Standards and Technology
D. K. Harman
Table 16: i-[OCRerr]es[OCRerr],
Precision at 15 Documents
Mean SD
Rnns Difference Difference i Probability
r[OCRerr]hiZo/rJohi 0.0013 0.0285 0.3305 0.7424
r[OCRerr]h[OCRerr]Io/emim 0.0040 0.0367 0.7712 0.4443
r[OCRerr]lohi/emim 0.0027 0.0300 0.6282 0.5328
r[OCRerr]hilo/porier 0.0067 0.0278 1.6973 0.0960
r[OCRerr]lohi/porter 0.0053 0.0325 1.1579 0.2525
emim/porter 0.0027 0.0380 0.4957 0.6224
r[OCRerr]hilo/wpq 0.0067 0.0337 1.3999 0.1678
r[OCRerr]lohi/wpq 0.0053 0.0352 1.0703 0.2897
emim/wpq 0.0027 0.0232 0.8137 0.4197
porier/wpq 0.0000 0.0404 0.0007 0.9994
Table 17: t-tesi,
Precision at 30 Doc[OCRerr][OCRerr]xnent[OCRerr]
Mean SD
Runs Difference Difference t Probability
r[OCRerr]hi1o/r[OCRerr]lohi -0.0080 0.0298 -1.8984 0.0635
r[OCRerr]hilo/emim -0.0087 0.0583 -1.0521 0.2979
r[OCRerr]lohi/emim -0.0007 0.0585 -0.0810 0.9358
r[OCRerr]hilo/porter 0.0067 0.0539 0.8748 0.3860
r[OCRerr]lohi/ porter 0.0147 0.0518 2.0019 0.0508
emim/porter 0.0153 0.0694 1.5624 0.1246
r[OCRerr]hilo/wpq -0.0013 0.0534 -0.1770 0.8602
r[OCRerr]lohi/wpq 0.0067 0.0530 0.8882 0.3788
emim/wpq 0.0073 0.0458 1.1312 0.2635
porter/wpq -0.0080 0.0450 1.2590 0.2140
Table 20: [OCRerr]-iest,
Rerall
Mean SD
Runs Difference Difference i Probability
r[OCRerr]hilo/r[OCRerr]Iohi 0.0005 0.0312 0.1052 0.9166
r[OCRerr]hilo/emim 0.0363 0.0743 3.4503 0.0012
r[OCRerr]lohi/emim 0.0358 0.0819 3.0935 0.0033
r[OCRerr]hi Jo/porter 0.0731 0.1094 4.7267 0.0000
r[OCRerr]lohi/ porter 0.0727 0.1108 4.6356 0.0000
emim/porter 0.0369 0.0965 2.7010 0.0095
r[OCRerr]hilo/wpq 0.0506 0.0835 4.2805 0.0001
r[OCRerr]lohi/wpq 0.0501 0.0908 3.9007 0.0003
emim/wpq 0.0143 0.0529 1.9106 0.0619
porter/wpq -0.0226 0.0739 -2.1583 0.0358
Table 18: t-iest,
Precision at 100 Documents
Runs
r~hilo/r~lohi
r~hilo/emim
r~1ohi/emim
r~hilo/porter
r[OCRerr]lohi/ porter
emim/porter 0.0140 0.0535 1.8494 0.0704
r[OCRerr]hiJo/wpq 0.0278 0.0557 3.5311 0.0009 Table 21: i-lest,
r[OCRerr]lohi/wpq 0.0270 0.0600 3.1815 0.0025 Recall/Precision
emim/wpq 0.0056 0.0301 1.3150 0.1946 Mean SD
Runs Difference Difference t Probability
porter/wpq -0.0084 0.0410 1.4496 0.1536
r[OCRerr]hilo/r[OCRerr]Johi 0.0003 0.0246 0.0978 0.9225
r[OCRerr]hiJo/emim 0.0138 0.0450 2.1635 0.0354
r[OCRerr]Johi/emim 0.0134 0.0517 1.8396 0.0719
r[OCRerr]hi Jo/porter 0.0369 0.0636 4.1048 0.0002
r[OCRerr]Johi/porter 0.0366 0.0669 3.8626 0.0003
Table 19: t[OCRerr]tes1,
Average Precision emim/porter 0.0231 0.0576 2.8398 0.0066
Mean SD r[OCRerr]hi'o/wpq 0.0231 0.0532 3.0729 0.0035
Runs Difference Difference t Probability r[OCRerr]lohi/wpq 0.0228 0.0635 2.5401 0.0143
r[OCRerr]hilo/rJohi -0.0026 0.0153 -1.1935 0.2384 emim/wpq 0.0094 0.0313 2.1135 0.0397
r[OCRerr]hilo/emim 0.0212 0.0421 3.5637 0.0008 porter/wpq -0.0138 0.0441 -2.2100 0.0318
r[OCRerr]lohi/emim 0.0238 0.0470 3.5786 0.0008
r[OCRerr]hi Jo/porter 0.0398 0.0615 4.5727 0.0000
r[OCRerr]Johi/porter 0.0424 0.0658 4.5547 0.0000
emim/porter 0.0186 0.0592 2.2172 0.0313
r[OCRerr]hiJo/wpq 0.0301 0.0537 3.9615 0.0002
r[OCRerr]Johi/wpq 0.0327 0.0603 3.8291 0.0004
emim/wpq 0.0089 0.0335 1.8726 0.0671
porter/wpq -0.0097 0.0358 -1.9107 0.0619
288