SP500215
NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2)
Combination of Multiple Searches
chapter
E. Fox
J. Shaw
National Institute of Standards and Technology
D. K. Harman
Table 8: Average
(Ad-hoc Topics 51-100).
Precision and Exact R-Precision for CombSUM runs combining two or three individual runs
Average Precision
Run AP-1 wsJ-1 AP-2 WSJ-2 AP-l
SV 0.2387 0.2203 0.2543 0.1503 0.2624
LV 0.2435 0.2414 0.2664 0.1633 0.2672
Pnl.0 0.2810 0.2941 0.3004 0.2206 0.2688
Pnl.5 0.3122 0.3199 0.3332 0.2327 0.2976
Pn2.0 0.3027 0.3217 0.3300 0.2325 0.2968
;½
R- Precision
AP-2
0.2649
wsJ-1
0.2616
WSJ-2
0.1744
0.2800 0.2704 0.1860
0.3221 0.3165 0.2367
0.3443 0.3412 0.2511
0.3470 0.3339 ¾; 0.2442
SV and LV 0.1457 0.1657 0.1611 0.1100 0.1492 0.1887 0.1524 0.1124
SV and Pnl.0 0.2774 0.3111 0.3257 0.2362 0.2874 0.3332 0.3360 0.2554
SV and Pnl.5 0.3117 0.3389 0.3614 0.2463 0.3198 0.3575 0.3675 0.2637
SV and Pn2.0 0.3012 0.3395 0.3584 0.2467 0.3153 0.3580 0.3636 0.2551
LV and Pnl.0 0.2744 0.3136 0.3197 0.2353 0.2867 0.3357 0.3269 0.2518
LV and Pnl.5 0.3057 0.3413 0.3536 0.2442 0.3181 0.3596 0.3624 0.2568
LV and Pn2.0 0.2950 0.3408 0.3518 0.2458 0.3141 0.3608 0.3596 0.2615
Pnl.0 and Pnl.5 0.2817 0.3109 0.3243 0.2324 0.2898 0.3412 0.3395 0.2476
Pnl.0 and Pn2.0 0.2935 0.3191 0.3330 0.2367 0.2944 0.3426 0.3397 0.2507
Pnl.5 and Pn2.0 0.2928 0.3233 0.3336 0.2328 0.2935 0.3478 0.3351 0.2489
Pnl.0, Pnl.5 and Pn2.0 0.2943 0.3192 0.3345 0.2339 0.2953 0.3421 0.3386 0.2497
(TREC-1), D.K. Harmon (Ed.), National Institute
of Standards and Technology Special Publication
500-207, Gaithersburg, MD.
[5] Katzer, J., McGill, M.J., Tessier, J.A., Frakes, W.,
Dasgupta, P. (1982). A Study of the Overlap among
Document Representations. Inform ajion Technol-
ogy: Reseach and Developmeni, 1(2) :261-274.
[6] Thompson, P. (1990) A Combination of Expert
Opinion approach to probabilistic information re-
trieval, Part 1: The conceptual model. Informa[OCRerr]ion
Processing [OCRerr] Managemeni, 26(3):371-382, 1990.
[7] Thompson, P. (1990). A Combination of Expert
Opinion approach to probabilistic information re-
trieval, Part 2: Mathematical treatment of CEO
Model 3. Informalion Processing [OCRerr] Managemeni,
26(3) :383-394.
249