IRS13 Evaluation Parameters chapter E. M. Keen Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. Interpolated Curve - - Original Curve Precision Precision 0.6 1.0 0.5 0.8 I, I I 0.6I 0.4 I- I [OCRerr] 0.2 I I I I I 0 0.2 0.4 0.6 0.8 1.0 Ranks of N'ive Relevant are [OCRerr] Recall a) Curve for Individual Request [OCRerr] 268 Cran-l, Thesaurus-2, using Recall levels cut-off - "Semi-Cranfield" Method Recall Level Cut-off, NQua8i[OCRerr]Cr I' Recall Level Cut-off, tmSemi - Ci Document Cut-off, *Pieudo-[OCRerr] I' -0-> ¼ K I I I Reco 0.2 0.4 0.6 0.8 1.0 Cran-l, Abstracts, Thesaurus-3, Macro Evaluation of 42 Requests b) Average Curve to C[OCRerr]pare Cut-offs 0.4 0.3 0.2 - 0.1 0 Illustrations of the Recall Levels Cut-off - "Semi-Cranfield" Method Fig. 17