IRE Index index Butterworth & Company Karen Sparck Jones All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, including photocopying and recording, without the written permission of the copyright holder, application for which should be addressed to the Publishers. Such written permission must also be obtained before any part of this publication is stored in a retrieval system of any nature. Data, accuracy of, 114 analysis of, 85 implementation, 99 medium, 99 collection of, 83, 163 comparison, 94 estimation, 92 exploring relationships, 97 presentation of results, 100 scale of measurement, 92 statistical inference, 91 Database, 61 building, 70 characteristics of indexing, 71 choice of, 70 collection coverage, 71 commercial, 73 constraints on testing, 130 coverage of, 114 form of surrogates, 71 INSPEC, 73 medium of, 72 search, 133 size of, 70 SMART, 72 structure of, 71 Definitions, 9 Delphi technique, 85 Descriptive methods of testing, 85 Destination's relevance, 47 DIALOG, 129 Discrimination model, 324 Discrimination value, 324 DOAE test, 233, 256, 282 Documents, 13 assessments of relevance, 74 automatic classification, 323 clustering, 157, 159, 239 collection of, 61 heterogeneity of, 61 definition, 9 delivery test, 119 delivery time, 185 description, 161 forms of, 61 for tests, 287 identification, 1 identification of, 181 indexing, 317 in SMART, 319 management, 1 ranking, 87 surrogates, 71 weighting surface, 188 Document access information, 216 Document-term incidence array, 89 Effectiveness of systems, 10, 32[OCRerr]3, 228 concept of, 48 I i[OCRerr],l, [OCRerr]I' Effectiveness of systems (cont.) definition, 106, 168 description approach, 39 evaluation of, 133,134, 173 limits of retrieval, 40 measurement, 33, 38 online systems, 133, 134 optimal retrieval, 35 predictive approach, 39 probability ranking principle, 35 relevance-based, 168 relevance feedback strategies, 40 SMART, 327 theoretical foundations, 33 Efficiency of systems, 10, 69 improvement of, 77 Electric Electric Library, 265 Environment of retrieval systems, 316 EPSILON, 84, 139, 144, l4[OCRerr], 149, 233, 234 design, 237 results, 153 users, 231 Estimates, making of, 199 Estimation, 92 standard error, 92, 94 Evaluation, 4, 66, 105-127, 222, 228, 245, 323 accuracy of data, 114 analysis and interpretation, 117 application of results, 123 behavioural intervention, 122 compromises, 119, 121 computer processing, 116 controlled experimentation, 121 control of variables, 115 cost effectiveness, 110 cost factors, 107, 110,120 costs, 114 coverage, 114 criteria, 109 definition of scope, 115 design of, 117 effectiveness, 133, 134, 173 execution of programme, 117 input/output/outcome distinction, 109 indexing, 116 in experimental and operating environment, 121 levels of, 106 macro- and micro-, 108 novelty, 114 objectives, 115 precision ratio in, 120 problems of, 115 proof and insight-oriented studies, 122 recall and precision see also Recall and Precision, 111, 113 recall ratio, 121 requirements for, 286 response time, 114, 117 searching in, 116, 236 simulation and, 119