IRS13 Scientific Report No. IRS-13 Information Storage and Retrieval Table of Contents table of contents Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. SUMMARY fr[OCRerr]PORTS ON EVALUATION PROCEDURE AND RESULTS 1965-1967 TABLE OF CONTENTS Page xi I. KEEN, E. M `1Test Environment" 1. Introduction . * . * * * 2. Document Collections and Search Requests 3. Relevance Decisions * * * * [OCRerr]. Text Experiments A) Experimental Procedures . B) Variables Tested * * . * C) Vocabularies and Index Language Devices 5. Relevance Grade Test Results * * 6. Request and Collection Comparisons A) Request Preparation . e * B) Specific and General Requests . C) Collection Comparisons * 1-1 * 1-1 I-S * 1-11 1-11 * 1-13 * 1-17 * I-2'4 * 1-28 * 1-28 * 1-31 I-[OCRerr]l References I-[OCRerr]8 II. KEEN, E. M "Evaluation Parameters" 1. Introduction * * * * * * * 2. Purposes, Viewpoints and Properties of Performance Measures * * * * * * * 3. Measures for Ranking Systems * * * * iv 11-1 * * 11-1 11-6