SP500207 Description of the PRC CEO Algorithm for TREC chapter P. Thompson National Institute of Standards and Technology Donna K. Harman Top ranked evaluation Runnumber: 1 Num[OCRerr]queries: 47 Total number of documents over all queries Retrieved: 9400 Relevant: 3697 Rel_ret: 1366 Recall - Precision Averages: at 0.00 0.3801 atOlO 0.2588 at0.20 0.2379 at0.30 0.1638 at0.40 0.1144 atOSO 0.0831 at0.60 0.0551 at 0.70 0.0363 at0.80 0.0101 at0.90 0.0002 at 1.00 0.0002 Average precision for all points 11-ptAvg: 0.1218 Average precision for 3 intermediate points (0.20, 0.50, 0.80) 3-ptAvg: 0.1104 Recall: Exact: at Sdocs: at 15 docs: at 30 docs: atlOOdocs: at200docs: 0.4114 Precision: Exact: 0.1453 At Sdocs: 0.1915 Atl5docs: 0.2156 At30docs: 0.1879 AtlOOdocs: 0.1683 At200docs: 0.1453 0.4114 0.0137 0.0497 0.0800 0.2249 Figure 3. Post-TREC summary results with 11-point average weights and only NIST relevance judgments 341