IRS13 Evaluation Parameters chapter E. M. Keen Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. 11-67 References (13 G. Salton, The Evaluation of Computer-Based Information Retrieval Systems, Proceedings 1965 International FID Congress, Spartan Books, Washington, 1966. [23 C. Cleverdon and M. Keen, Factors Determining the Performance of Indexing Systems, Volume 2, Test Results, Aslib Cranfield Research Project, Cranfield, 1966. [33 J. A. Swets, Effectiveness of Information Retrieval Methods, Report No. 1499, Bolt Beranek and Newinan Inc., Cambridge, Mass., Draft, April 1967. [4] G. Salton, The Evaluation of Automatic Retrieval Procedures - Selected Test Results Using the SMART System, American Docu- mentation, Vol. 16, No. 3, July 1965 (Also ISR-8, Section IV). [53 J. J. Rocchio, Evaluation Viewpoint in Document Retrieval, Information Storage and Retrieval, Report ISR-9, to the National Science Foundation, Section XXI, Harvard Computation Laboratory, August 1965. [6] J. J. Rocchio, Document Retrieval Systems - Optimization and Evaluation, Doctoral Thesis, Report ISR-1O, to the National Science Foundation, Harvard Computation Laboratory, April 1966. [73 J. A. Swets, Information Retrieval Systems, Science, Vol. 141, 19 July 1963. [83 V. E. Giuliano and P. E. Jones, Study and Test of Methodology for Laboratory Evaluation of Message Retrieval Systems, Interim Report ESD-TR-66-405, Decision Sciences Laboratory, Electronic System Division, U.S.A.F., Contract to A. D. Little Inc., August 1966. [9] G. Salton and M. E. Lesk, Computer Evaluation of Indexing and Text Processing - Automatic Indexing Methods are Evaluated and Design Criteria for Modern Information Systems are Derived, Report ISR-12, to the National Science Foundation, Section III, Cornell University, June 1967. [103 5. J. Sillers, Distinguishing Retrieved from Nonretrieved Information: The Cut-off Problem, Information Storage and Retrieval, Report ISR-9, to the National Science Foundation, Section XXII, Harvard Computation Laboratory, August 1965.