ISR10 Appendix A: The Smart System appendix Joseph John Rocchio Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. A-4 sytem to incorporate a variety of query-[OCRerr]ocument matching functions. In a[OCRerr][OCRerr]ition to the cosine correlation measure for vector mo[OCRerr]e images, several correlation measures suitable for set mode index images are provided. Additionally, new index image comparison functions may be easily programmed for experimental purposes. D. Evaluation Assuming that relevance judgments are available for test search requests, [OCRerr] has the capability of automatically generating a variety of evaluation measures for each retrieval operation, including those discussed in section 4 of chapter 5. Additionally, the system provides sufficient output such that auxiliary programs can produce system evaluations over a number of searches,. i.e. parameter averages, average precision vs. average recall plots, etc. [OCRerr]ovel evaluation algorithms may, theref ore,[OCRerr]be applied to a number of searches by construction of computer programs to process such data.