IRE Laboratory tests: automatic systems chapter Robert N. Oddy Butterworth & Company Karen Sparck Jones All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, including photocopying and recording, without the written permission of the copyright holder, application for which should be addressed to the Publishers. Such written permission must also be obtained before any part of this publication is stored in a retrieval system of any nature. 176 Laboratory tests: automatic Systems I I, we should not be satisfied with this. What I think we need is an equally fruitful interaction between theory development and a new type of automated laboratory, closer to real life information retrieval services, where we can perhaps test models of human users in conjunction with theories of document collections. References 1. BODEN, M. A. Artificial Intelligence and Natural Man, Harvester Press, Hassocks, Sussex (1977) 2. SPARCK JONES, K. Automatic Keyword Classification for Information Retrieval, Butterworths, London (1971) 3. JARDINE, N. and VAN RIJ5BERGEN, C. J. The use of hierarchic clustering in information retrieval, Information Storage and Retrieval 7, 217-240(1971) 4. ROCCHIO, J. J. Document Retrieval Systems-Optimization and Evaluation, Ph.D. Thesis, Report ISR-10, Computation Laboratory, Harvard University (1966) 5. CROFT, W. B. Organizing and Searching Large Files of Document Descriptions, Ph.D. Thesis, Computer Laboratory, University of Cambridge (1978) 6. SPARCK JONES, K. and BATES, R. G. Research on Automatic Indexing 1974-1976, 2 Vols, British Library Research and Development Report 5464, Computer Laboratory, University of Cambridge (1977) 7. SALTON, G., WONG, A. and YU, C. T. Automatic indexing using term discrimination and term precision measurements, Information Processing and Management 12, 43-51(1976) 8. SALTON, G. The SMART Retrieval System-Experiments in Automatic Document Processing, Prentice-Hall, Englewood Cliffs, N.J. (1971) 9. EIARPER, D. J. and VAN RIJSBERGEN, C. J. An evaluation of feedback in document retrieval using co-occurrence data, Journal ofDocumentation 34, 189-216 (1978) 10. SPARCK JONES, K. Search term relevance weighting given little relevance information, Journal of Documentation 35, 3048 (1979) 11. MCGILL, M. J. Knowledge and information spaces: implications for retrieval systems, Journal of the American Society for Information Science 27, 205-210 (1976) 12. VAN RIJSBERGEN, C. J. Information Retrieval, 2nd edn, Butterworths, London (1979) 13. ROBERTSON, 5. E. and SPARCK JONES, K. Relevance weighting of search terms, Journal of the American Society Jar Information Science 27, 129-146 (1976) 14 CLEVERDON, C, W., MILLS, J. and KEEN, E. M. Factors Determining the Performance oflndexing Systems, Vol.1, Design, Vol.11, Test Results, Aslib Cranfield Project, College of Aeronautics, Cranfield (1966) 15. ROBERTSON, S. E. Theories and models in information retrieval, Journal of Documentation 33, 126-148(1977) 16. SALTON, G. Mathematics and information retrieval, Journal ofDocumentation 35, 1-29(1979) 17. VAN RIJSBERGEN, C. J. A theoretical basis for the use of c[OCRerr]occurrence data in information retrieval, Journal of Documentation 33, 106119(1977) 18. SALTON, o. A Theory ofindexing, Regional Conference Series in Applied Mathematics No 18, Society for Industrial and Applied Mathematics, Philadelphia (1975) 19. BELKIN, N. J. and ODDY, R. N. Design Study for an Anomalous State of Knowledge Based Information Retrieval System, British Library Research and Development Report 5547(1979) 20. SPARCK JONES, K. and VAN RIJSBERGEN, C. J. Information retrieval test collections, Journal of Documentation 32, 59-75 (1976) 21. GRIFFIThS, J.-M. The Computer Simulation of Information Retrieval Systems, Ph.D. Thesis, School of Library, Archive and Information Studies, University of London (1978) 22. ROBERTSON, S. E. A Theoretical Model of the Retrieval Characteristics of Information Retrieval Systems, Ph.D. Thesis, University of London (197 6)I 23. SPARCK JONES, K. and VAN RIJSBERGEN, C. J. Report on the Need for and Provision ofan `Ide al'q Injormation Retrieval Test Collection, British Library Research and Development Report 5266, Computer Laboratory, University of Cambridge (1 975)I 24. AUGUSTSON, J. G. and MINKER, J. An analysis of some graph-theoretic cluster techniques, Journal ofthe ACM 17, 571-588 (1970) I