IRS13 Evaluation Parameters chapter E. M. Keen Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. 11-17 Request QA12 S Relevant Documents Cosine Numeric - Ranks of Relevant 1, 3,1[OCRerr],l7,l8 Cosine Logical - Ranks of Relevant 1,2,3,18,23 Precision 1.00 0 75. - 0.50 0.25 Cosine III! V [OCRerr]Logical Cumin~ I I Cosine Cosine Numeric Logical Normed Recall .9013 .9169 Normed Precision .7270 .8230 I I Recall 0.i*25 0.'50 0:75 l'.06 Request [OCRerr] 2 Relevant Documents Cosine Numeric - Ranks of Relevant 1,15 Cosine Logical - Ranks of Relevant 2,3 Precision Cosine Cosine 1.00 Numeric Logical 0.75. Normed Recall .9188 9875 Normed Precision .7515 .861[OCRerr]5 0.50 0.25 I I all 0.25 o;sd 6.75 1.00 NOTE: Precision Recall curves are extrapolated to 1.0 Precision 0.0 Recall, as discussed in Part [OCRerr]C. Results of Two Individual Requests from the ADI, Text, Suffix `S', Cosine, Numeric Versus Logical Runs, showing merit assigned by normalized measures and precision recall curves Fig. 9