SP500215 Design and Evaluation of the CLARIT-TREC-2 System chapter D. Evans R. Lefferts National Institute of Standards and Technology D. K. Harman [OCRerr]ffIciaI TREtC-2 Rasult 0.5 - - - 0.2 - - 0- - 0.0 0.1 0.2 0.3 0.4 0.5 0.8 0.7 0.9 0.5 1.0 Racall Automatic Ad-[OCRerr]oc at 1000 Documants [OCRerr] Avaraga - .3264 I Manual Ad-[OCRerr]oc at 1 000 Dacumants [OCRerr] Avaraga - .3393 Figure 3: P-R Curve for Ad-Hoc Cueries Over 1000 Docs-CLARTM and CLARTA CLARTM Ad-Hoc Queries, 101-150 Total number of documents over all queries Retrieved: 50000 Relevant: 10785 Rel[OCRerr]t: 8229 Interpolated Recall-Precision Averages: at 0.00 0.7455 at 0.10 0.5811 at 0.20 0.5240 at 0.30 0A622 at OAO 0A135 at 0.50 0.3593 at 0.60 0.2983 at 0.70 0.2312 at 0.80 0.1516 at 0.90 0.0874 at 1.00 0.0062 Average Precision (non-interpolated) over all rel docs: 0.3383 Precision: At 5 docs: 0.5840 At 10 docs: 0.5740 At 15 docs: 0.5640 At 20 docs: 0.5590 At 30 docs: 0.5433 At 100 docs: 0A846 At 200 docs: 0.3975 At 500 docs: 0.2601 At 1000 docs: 0.1646 R-Precision (precision after Rretrieved) Exact 0.3741 CLARTA Ad-Hoc Queries, 101-150 Total number of documents over all queries Retrieved: 50000 Relevant: 10785 Rel[OCRerr]t: 8109 Interpolated Recall-Precision Averages: at 0.00 0.7587 at 0.10 0.5676 at 0.20 0.5038 at 0.30 0.4489 at OAO 03938 at 0.50 0.3455 at 0.60 0.2806 at 0.70 0.2172 at 0.80 0.1463 at 0.90 0.0827 at 1.00 0.0070 Average Precision (non-interpolated) over all rel docs: 0.3264 Precision: At 5 docs: 0.5800 At 10 docs: 0.5680 At 15 docs: 0.5547 At 20 docs: 0.5490 At 30 docs: 0.5253 At 100 docs: 0A644 At 200 docs: 0.3874 At 500 docs: 0.2542 At 1000 docs: 0.1622 R-Precision (precision after R retrieved) Exact 0.3645 Table 2: Offical Results1 Ad-Hoc Topics 101-150 142