SP500215 NIST Special Publication 500-215: The Second Text REtrieval Conference (TREC-2) Description of the PRC CEO Algorithm for TREC-2 chapter P. Thompson National Institute of Standards and Technology D. K. Harman our summary official TREC-2 results for versions 1 and 2 respectively. Queryid (Num): all prceol Total number of documents over all queries Retrieved: 50000 Relevant: 10785 Rel_ret: 3561 Interpolated Recall - Precision Averages: at 0.00 0.4768 at 0.10 0.2613 at 0.20 0.1807 at 0.30 0.1202 at 0.40 0.0875 at 0.50 0.0504 at 0.60 0.0328 at 0.70 0.0169 at 0.80 0.0142 at 0.90 0.0077 at 1.00 0.0031 Average precision (non-interpolated) over all rel does 0.0904 Precision: At S docs: 0.2120 At 10 docs: 0.2480 At 15 docs: 0.2707 At 20 docs: 0.2760 At 30 docs: 0.2753 At 100 docs: 0.2418 At 200 docs: 0.1756 At 500 does: 0.1086 At 1000 docs: 0.0712 R-Precision (precision after a query) docs retrieved): Exact: 0.1703 R(=num_relfor Queryid (Num): Total number of Retrieved: Relevant: Rel_ret: Interpolated at 0.00 at 0.10 at 0.20 at 0.30 at 0.40 at 0.50 at 0.60 at 0.70 at 0.80 at 0.90 at 1.00 Average precision rel docs all prceol documents over all queries 50000 10785 3323 Recall - Precision Averages: 0.5963 0.3270 0.2306 0.1430 0.0866 0.0425 0.0323 0.0246 0.0209 0.0131 0.0041 (non-interpolated) over all 0.1120 Precision: At S docs: 0.4120 At 10 docs: 0.4000 At 15 docs: 0.3920 At 20 docs: 0.3740 At 30 docs: 0.3527 At 100 docs: 0.2722 At 200docs: 0.1974 At SOodocs: 0.1090 At 1000 docs: 0.0665 R-Precision (precision after R (= numjel for a query) docs retrieved): Exact: 0.1809 Figure 1: Summary scores 1 using two best experts for PRC version Figure 2: Summary scores for PRC version 2 using five best experts 273