SP500215 UCLA-Okapi at TREC-2: Query Expansion Experiments chapter E. Efthimiadis P. Biron National Institute of Standards and Technology D. K. Harman Table 4: Sign Test Difference8, Pr[OCRerr][OCRerr]iq[OCRerr]n[OCRerr] At 1 .[OCRerr] fl[OCRerr][OCRerr]iivn[OCRerr][OCRerr]ta _______ I' wpq porter emim r[OCRerr]lohi r[OCRerr]hilo j wpq Ijo 3 1 3 2 1 porter Il[OCRerr] 0 4 3 1 [OCRerr] emim 112 4 0 3 4 I r[OCRerr]Iohi [[[OCRerr]s 6[OCRerr] 4 0 r[OCRerr]hito 5 3 j Table 5: Sign Test Probabilities, _______ Precision at 15 Documents ________ [1 wpq porter emim r[OCRerr]lohi r[OCRerr]hi1o wpq II 1.0000 porter II 1.0000 1.0000 emim 1.0000 1.0000 1.0000 r[OCRerr]lohi II 0.7266 0.5078 1.0000 1.0000 r[OCRerr]hilo 0.4531 0.2188 1.0000 1.0000 1.0000 Table 6: Sign Test Differences, _______ Precision at 30 Documents L[OCRerr] _ _1' [OCRerr] r[OCRerr]hiIo 1.0000 [OCRerr]j 0.3613 1.0000 [OCRerr] 0.8445 0.7277 1.0000 [1 0.4725 0.2652 0.8638 1.0000 _______ 0.8501 0.3613 0.7353 0.1338 1.0000 Table 8: Sign Test Differences, _______ Precision at 100 Documents LII 3. able 9: Sign Test Probabilities, T Precision at 100 [OCRerr] 1.0000 porter 0.3239 1.0000 wpg II wpq porter emim r[OCRerr]1ohi r[OCRerr]hi1o emim 0.0543 0.2002 1.0000 r[OCRerr]lohi 0.0003 0.0004 0.0250 1.0000 r[OCRerr]hiJo 0.0003 0.0002 0.0046 1.0000 1.0000 Table 10: Sign Test Differences, _______ Average Precision [ _______ II wpq porter emim r[OCRerr]lohi r[OCRerr]hiIo ] wpq f[ 0 29 15 10 11 porter 20 0 17 9 10 em:m [OCRerr] 25 32 0 13 16 r[OCRerr]lohi II [OCRerr] 40 36 0 31 r[OCRerr]hilo 38 39 33 17 0 r _______ wpq porter emim r[OCRerr]1ohi r[OCRerr]hilo wpq 0 18 12 13 15 porter 12 0 15 11 12 emim 14 18 0 16 19 r[OCRerr]1ohi 18 18 18 0 15 r[OCRerr]hilo 13 18 16 7 0 Table 7: Sign Test Probabilities, ________ Precision at 30 Documents [ ________ wpq porter emim r[OCRerr]1ohi 3 wpq porter em:m r[OCRerr]Johi r[OCRerr]hilo _______ wpq porter emim r[OCRerr]lohi r[OCRerr]hi1o wpq 0 22 8 8 8 porter 15 0 15 8 8 emim 19 24 0 12 9 r[OCRerr]lohi 32 31 27 0 15 r[OCRerr]hiIo 32 33 27 14 0 L. __ 287 Table 11: Sign Test Probabilities, Average Precision I II wpq 111.00001 porter II0.25311.0000I em:m II0.15470.04551.0000I r[OCRerr]loh: [OCRerr]0.00010.00000.00171.0000 r[OCRerr]hilo 0.0002 0.0001 0.0223 0.0606 1.0000 Table 12: Sign Test Differences, _______ Recall r..II J Table 13: Sign Test Probabilities, ____ Recall [ ________ [1 wpq porter emim r[OCRerr]lohi r[OCRerr]hiIo ] wpq fi 1.0000 porter jI 0.0080 1.0000 emim jj 0.2100 0.0180 1.0000 r[OCRerr]Iohi II 0.0085 0.0000 0.0101 1.0000 r[OCRerr]hilo 0.0005 0.0000 0.0008 1.0000 1.0000 Table 14: Sign Test Differences, ______ Recall/Precision (.11 I Table 15: Sign Test Probabilities, _______ Recall/Precision u,pq [OCRerr]ll 1[OCRerr]w00p0q0 porter emim r[OCRerr]lohi r[OCRerr]hilo ] porter jj 0.2012 1.0000 emim jj 0.0169 0.0062 1.0000 [OCRerr] rThlOh[OCRerr] It 0.0367 0.0008 0.2012 1.0000 hilo 0.0023 0.0017 0.1508 1.0000 1.0000 wpq porter emim r[OCRerr]1ohi r[OCRerr]hi[OCRerr]o I ________ wpq porter emim r[OCRerr]Iohi r[OCRerr]hilo wpq 0 24 8 10 7 porter 8 0 10 4 3 emim 15 25 0 9 6 r[OCRerr]Iohi 27 28 25 0 14 r[OCRerr]hiIo 29 32 26 14 0 _______ wpq porter emim r[OCRerr]1ohi r[OCRerr]hilo wpq 0 19 5 10 8 porter 11 0 7 6 7 emim 17 23 0 11 11 r[OCRerr]lohi 23 26 19 0 13 r[OCRerr]hiIo 27 26 20 12 0