SP500215 Design and Evaluation of the CLARIT-TREC-2 System chapter D. Evans R. Lefferts National Institute of Standards and Technology D. K. Harman Ofticial TREO-2 R.auit. ½ Precision 0.9 Os 07 Os - - - I Os - 0.4 - 0.3 - 0.2 - 0.1 - 0 5 10 15 20 30 [OCRerr] Manual Routing at N Docs 3if[OCRerr]-if 100 200 500 1000 m Automatic Ad-Hoc Number of Documents Automatic Routing [OCRerr] Manual Ad-Hoc Figure 4: Comparative Precision at N Documents >Median -Median <Median CLAR[OCRerr] CLARTA CLARIM CLARTA CLARTM CLARTA Precision 37 (1] 34 [0] 0 4 13 [0] 12 [0] Rels in Top 100 32 [2] 29 [2] 6 8 12 [1] 13 [1] Rels in Top 1000 36 [10] 36 [11] 5 6 9 [0] 8 [0] Table 3: Summary of Results for Routing (51-100) >Median -Median <Median CLARTM CLARTA CLARTM CLARTA CLAR[OCRerr] CLARTA Precision 38 [0] 34 [3] 4 7 8 [0] 9 [0] Rels in Top 100 39 [1] 31 [0] 3 2 9 [0] 17 [0] RelsinToplooD 44[4] 42[9] 2 2 4[0] 6[0] Table 4: Summary of Results for Ad-Hoc Queries (101-150) 143