ISR11 Operating Instructions for the SMART Text Processing and Document Retrieval System chapter M. E. Lesk Harvard University Gerard Salton Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government. 11-30 Foll[OCRerr]dng the *STOP card, the relevant document data needed for the automatic evaluation system must be submitted, if SCORES ts specified. If SCORES is not specified, relevant documei[OCRerr]ts are omitted. The cards containing the relevance data are preceded and followed by a card with *RELS in columns 1-5 and a blank in column 6. For each request, a card is punched with the request identifier in cols 1-12, and the nuniber of relevant documents in cols 13-16, right adjusted. This card is followed by a set of cards specifying the relevant documents. Each relevant document identifier is punched in cols 1-12 of a separate card. Columns 13-15 should be left blank, as these are reserved for a future extension of the evaluation program to include degrees of relevance. Relevance judgment data may be placed on either [OCRerr] or [OCRerr]. If relevance judgments are given, they must occur as one continuous deck of cards, surrounded by *REL& cards, placed after the *sTOP card. Exactly one set of relevance judgments should be supplied for each request (i.e., documents preceded by *FIND or *LIKE cards). These relevance judgments may be on either tape, in any order. All document and request identifiers, however, must be spelled in exactly the same way on the relevance judgment cards as on the *FIND, *LIKE, and *TEXT cards. Relevance judgments may be placed on A6, whether or not SCORES is requested when the tape is read, but if SCORES is not specified and A(1[OCRerr]IN is specified, there should be no relevance judgments on A2. [OCRerr].5 Other Instruction Cards To place comments on the print tape, the *NOTE card is used. This card contains a *T[OCRerr]OTE in columns 1-5, blank in column 6, and comments to be printed and ignored in columns 6-72. Printing is done off-line.