ISR10 Evaluation of Document Retrieval Systems chapter Joseph John Rocchio Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. 5-4 [OCRerr]S;Je DeYi:ion DeYclazeimon T i 1 relevant retrieve 2 nonrelevant retrieve 3 relevant not retrieve .\\. 4 nonrelevant [OCRerr] not retrieve a) The Sample Space 0£ the Outcomes 0£ a Thetrieval Operation on a Single Document Thelevant [OCRerr]onrelevant:. Thetrieve& n n2 n1 + n2 1 [OCRerr]ot Thetrieve[OCRerr] n3 n n +n 4 .3 4 =n + *n1 +n n +n n2 + 3 2'4 1 n + n 3 4 b) The 2-by-2 Contingency Table 0£ Thetrieval an[OCRerr] the Outcomes 0£ a. Thetrieval Operation on[OCRerr] Characterization of Retrieval Results Fi[OCRerr]ure 5.1 Relevance - Documents