SP500215 UCLA-Okapi at TREC-2: Query Expansion Experiments chapter E. Efthimiadis P. Biron National Institute of Standards and Technology D. K. Harman Table 1: Runs with and without query expansion for topics 51-100. (Runs are presented in descending `Recall' values.) Run name Avg Prec Prec[5] Prec[1O] Prec(15) Prec[30] Prec[1OO) R-Prec Recall bmlS.phb.qey rjohs 10 5 uclagsln 0.2960 0.5640 0.5160 0.4893 0.4400 0.3288 0.3465 0.7322 bmlS.phb.qey rjohi 10 10 uclagsln 0.2960 0.5640 0.5160 0.4907 0.4400 0.3288 0.3472 0.7320 bmlS.phb.qey rjohi 10 15 uclagsln 0.2961 0.5680 0.5160 0.4907 0.4400 0.3288 0.3472 0.7320 bmlS.phb.qey rjohi 10 10 uclagsly 0.2960 0.5640 0.5160 0.4907 0.4400 0.3288 0.3472 0.7320 bmlS.phb.qey r[OCRerr]iln 10 10 uclagsln 0.2860 0.5480 0.4900 0.4733 0.4167 0.3148 0.3327 0.7283 bmlS.phb.qey rjiilo 10 10 uclagsly 0.2860 0.5480 0.4900 0.4733 0.4167 0.3148 0.3327 0.7283 bmlS.phn.qen uclagsly 0.2849 0.5560 0.5040 0.4720 0.4200 0.3164 0.3328 0.7264 bm15.phn.qen uclagsln 0.2849 0.5560 0.5040 0.4720 0.4200 0.3164 0.3328 0.7264 bmlS.phb.qen uclagsly 0.2846 0.5560 0.5040 0.4720 0.4200 0.3166 0.3325 0.7262 bmlS.phb.qey e[OCRerr]ni 10 10 uclagsly 0.2746 0.5240 0.4960 0.4573 0.4027 0.2962 0.3106 0.7113 bmls.phb.qey cmi 10 10 uclagsln 0.2746 0.5240 0.4960 0.4573 0.4027 0.2962 0.3106 0.7113 bmlS.phb.qey r]ohi 20 5 uclagsln 0.2968 0.5760 0.5240 0.5027 0.4527 0.3362 0.3508 0.7060 bmlS.phb.qey rjohi 20 15 uclagsln 0.2969 0.5800 0.5280 0.5067 0.4520 0.3362 0.3512 0.7060 bmlS.phb.qey rJohi 20 10 uclagsln 0.2967 0.5800 0.5260 0.5067 0.4520 0.3364 0.3512 0.7060 bmlS.phy.qen uclagily 0.2406 0.4600 0.4680 0.4360 0.3800 0.2878 0.2967 0.6777 bmlS.phb.qey wpq 10 10 uclagsln 0.2590 0.5360 0.4980 0.4440 0.3900 0.2884 0.3017 0.6768 bmlS.phb.qey wpq 10 10 uclagsly 0.2590 0.5360 0.4980 0.4440 0.3900 0.2884 0.3017 0.6768 bmls.phb.qey wpq 10 15 uclagsln 0.2570 0.5160 0.4780 0.4520 0.3953 0.2882 0.2963 0.6750 bmlS.phb.qey rJohi 30 15 uclagun 0.2896 0.5760 0.5320 0.5173 0.4573 0.3388 0.3456 0.6691 bmlS.phb.qey r]ohi 30 10 uclagun 0.2890 0.5800 0.5420 0.5240 0.4520 0.3370 0.3445 0.6683 bmlS.phb.qey rJohi 30 5 uclagsln 0.2894 0.5840 0.5380 0.5133 0.4520 0.3370 0.3450 0.6678 bmlS.phb.qey ems 20 10 uclagsly 0.2458 0.5280 0.4880 0.4547 0.3873 0.2696 0.2875 0.6599 bmlS.phb.qey wpq 20 10 uclagsln 0.2443 0.5120 0.4660 0.4413 0.3847 0.2706 0.2838 0.6437 bmlS.phb.qey'wpq 10 5 uclagsln 0.2438 0.5440 0.4900 0.4533 0.3800 0.2740 0.2849 0.6423 bmlS.phb.qey wpq 10 5 uclagsly 0.2438 0.5440 0.4900 0.4533 0.3800 0.2740 0.2849 0.6423 bmlS.phb.qey por 10 10 uclagsly 0.2509 0.5320 0.4980 0.4560 0.4047 0.2862 0.2989 0.6362 bmlS.phb.qey por 10 10 uclagsln 0.2509 0.5320 0.4980 0.4560 0.4047 0.2862 0.2989 0.6362 bmlS.phb.qey cmi 30 10 uclagsly 0.2377 0.5280 0.4860 0.4480 0.3780 0.2666 0.2809 0.6331 bmlS.phb.qey por 20 10 uclagsly 0.2558 0.5320 0.5080 0.4760 0.4113 0.2856 0.3030 0.6323 bmlS.phb.qey wpq 20 15 uclagsln 0.2342 0.5240 0.4940 0.4333 0.3827 0.2690 0.2701 0.6288 bmlS.phb.qey por 30 10 uclagsly 0.2494 0.5000 0.5080 0.4733 0.4167 0.2926 0.3088 0.6270 bmlS.phb.qey wpq 30 10 uclagsln 0.2318 0.5280 0.4920 0.4387 0.3753 0.2620 0.2744 0.6121 bmlS.phb.qey wpq 30 15 uclagsln 0.2271 0.5040 0.4860 0.4467 0.3700 0.2646 0.2668 0.6079 bm15.phb.qey wpq 20 5 uclagsln 0.2266 0.5360 0.4820 0.4467 0.3707 0.2570 0.2699 0.6016 bmlS.phb.qey wpq 30 5 uclagsln 0.2173 0.5280 0.4680 0.4347 0.3660 0.2480 0.2651 0.5790 Table 2: Ad hoc results: Runs with and without query expansion (Runs are presented in descending `Recall' values.) for topics 101-150. Run[OCRerr]nstme Avg Prec Prec 5 Prec 10 Prec 15 Prec 30 Prec 100 R-Prec Recall uclaal: auto.bmlS.phb.qen.uclagsly 0.3345 0.5840 0.5380 0.4973 0.4333 0.3098 0.3629 10.81551 uclaa2: auto.bmlS.phb.qey:wpq-10-10.uclagsly 0.2957 0.5440 0.5180 0.4920 0.4207 0.2760 0.3289 10.77861 uclafi: fdbk.bm15.phb.qey:wpq-10-10.uclagsly 0.3090 0.5880 0.5220 0.4893 0.4360 0.2884 0.3459 10.7745 Table 3: Performace Averages over all Topics of the Ad hoc Runs with (Runs Naxried af[OCRerr]er the Algorithm used in the Expansion.) Query Expansion. Run[OCRerr]ame Avg Prec Prec 5] Prec[10] Precfls] Prec[30] Prec[160] R-Prec Recall r[OCRerr]lohi 0.3414 0.5880 0.5240 0.4947 0.4427 0.3152 0.3688 0.8290 [OCRerr]hiIo 0.3388 0.5880 0.5240 0.4960 0.4347 0.3160 0.3692 0.8333 emirn 0.3176 0.5880 0.5240 0.4920 0.4433 0.2938 0.3554 0.7989 uclaŁ1: wpq 0.3087 0.5880 0.5240 0.4893 0.4360 0.2882 0.3460 0.7753 por[OCRerr]er 0.2990 0.5880 0.5240 0.4893 0.4280 0.2798 0.3323 0.7457 286