IRE Information Retrieval Experiment Laboratory tests: automatic systems chapter Robert N. Oddy Butterworth & Company Karen Sparck Jones All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, including photocopying and recording, without the written permission of the copyright holder, application for which should be addressed to the Publishers. Such written permission must also be obtained before any part of this publication is stored in a retrieval system of any nature. References 177 [OCRerr]` [OCRerr]Al[OCRerr])N, G. Dynamic Information and Library Processing, Prentice-Hall, Englewood Cliffs, N.J. (1975) Ift IAXF.NDALE, P. B. An empirical model for machine indexing. In: Machine Thdexing[OCRerr]Progress [OCRerr]jnd Problems, Proceedings of the Third Institute on Information Storage and Retrieval, pp. 2(17 218, The American University, Washington D.C. (1962) 27 IIILLMAN, D. J. Negotiation of inquiries in an on-line retrieval system, Information Storage and Retrieval 4, 219-238 (1968) 2N [OCRerr].PARCK JONES, K. and KAY, M. Linguistics and Information Science, Academic Press, London (1973) [OCRerr] MoNTGOMERY, C. A. Linguistics and information science, Journal of the American Society for Inb)rmation Science 23,195-219 (1972) [OCRerr]I (`ROALL, I. F. An Introduction to the STATUS II Information Retrieval System (Version 2), united Kingdom Atomic Energy Authority, Harwell (1977) I INTERNATIONAL BUSINESS MACHINES. Program Product. Storage and Information Retrieval Systemi Virtual Storage (STAIRS/VS), Program Reference Manual, SHI2-5400-1, 2nd edn IBM (1974) 12 ROCCHIO, J. J. Evaluation viewpoints in document retrieval. In: The SMART Retrieval Syslem-Experiments in Automatic Document Processing (Ed. G. Salton), Prentice-Hall, F.nglewood Cliffs, N.J. (1971) I[OCRerr] ([OCRerr]DDY, R. N. Reference Retrieval Based on User Induced Dynamic Clustering, Ph.D. Thesis, (`omputing Laboratory, University of Newcastle upon Tyne (1975) `4 SPARCK JONES, K. Performance averaging for recall and precision, Journal of Informatics 2, 95-105 (1978) `[OCRerr] ROBERTSON, S. E. The probability ranking principle in IR, Journal ofDocumentation 33, 294- 304(1977) [OCRerr] VASWANI, P. K. T. and CAMERON, J. B. The National Physical Laboratory Experiments in Siatistical Word Associations and their Use in Document Indexing and Retrieval, Publication 42, Division of Computer Science, National Physical Laboratory, Teddington (1970) `7 CLEvERnoN, C. W. On the inverse relationship of recall and precision, Journal of Documentation 28, 195-201(1972) `N LANCASTER, F. W. Information Retrieval Systems: Characteristics, Testing, and Evaluation, Wiley, New York (1968) W COOPER, w. 5. On selecting a measure of retrieval effectiveness, Part 1: The `subjective' philosophy of evaluation, Part 2: Implementation of the philosophy, Journal ofthe American Society for Information Science 24, 87-100 and 413424 (1973) 4'). HALL, J. L. On-line Information Retrieval Sourcebook, Aslib, London (1977) 41. LANCASTER, F. W. MEDLARS: Report on the evaluation of its operating efficiency, American Documentation 20, 119-142 (1969) 42. LANCASTER, F. W. and FAYEN, E. G. Information Retrieval On-line, Melville Publishing Co., Los Angeles (1973) 4.'. BARRACLOUGH, E. D. On-line searching in information retrieval, Journal of Documentation 33, 220238 (1977) 44. ROBERTSON, S. E. and BELKIN, N.J. Ranking in principle, Journal ofDocumentation 34, 93-100 (1978) 45. SARACEVIC, T. Relevance: A review of and a framework for the thinking on the notion in information science, Journal of the American Society for Information Science 26, 321-343 (1975) 46. DE MEY, M. The relevance of the cognitive paradigm for information science. In: Theory and Application of Information Research, Proceedings of the Second International Research Forum on Information Science (Ed. 0. Harbo and L. Kajberg), pp.48-61, Mansell, London (1980) 47 noYLE, L. B. Expanding the editing function in language data processing, Communications of the ACM 8,238-243(1965) 48. BELKIN, N.J. The problem of `matching' in information retrieval. In: Theory and Application of Information Research, Proceedings of the Second International Research Forum on Information Science (Ed. 0. Harbo and L. Kajberg), pp.187-197, Mansell, London (1980) 49. BEISHON, J. and PETERS, G. Systems Behaviour, 2nd edn, Harper & Row, London (1976) 50. FARRELL, B. A. Some thoughts on the use of models in psychology. In: Proceedings of the Third International Congress for Logic, Methodology and Philosophy of Science (Ed. B. van Rootselaar and J. F. Staal), pp.415430, North-Holland, Amsterdam (1968) SI. SIMON, H. A. The Sciences of the Artificial, MIT Press, Cambridge, Mass. (1969)