IRS13
Scientific Report No. IRS-13 Information Storage and Retrieval
An Analysis of the Documentation Requests
chapter
E. M. Keen
Harvard University
Gerard Salton
Use, reproduction, or publication, in whole or in part, is permitted for any purpose of the United States Government.
x-l
X. An Analysis of the Documentation Requests
E. M. Keen
1. Introduction
Conclusions from the experiments performed with SMART have so far
been made on the basis of the average results achieved for a set of search
requests. Studies presented in sections III, V, VI, VII, VIII of this report
have presented such results, and given in addition some elementary data about
the individual requests, and examples of detailed system performance The
purpose of this study is to uncover still more of the variables and charac-
teristics of the requests themselves in the context of the test environment
and of the capabilities of the SMART system, in order to reveal basic prob-
lems and suggest in[OCRerr]rovements to the system. The 35 requests associated with
the 82 document collection in documentation are used because the author's
knowledge of the subject field aids the investigation.
2. Request Preparation
In section I, a brief description of the ADI documentation collec-
tion, requests, and relevance decisions is given. The collection consists
of 82 documents, both in abstract and short text form. Requests were prepared
by two non-users of the system, and the relevance decisions were also made
by these persons by examining every document for potential relevance.
The request preparers were graduate students at Harvard University,
one an engineer, and one an applied mathematician. Since neither person