IRE Laboratory tests of manual systems chapter E. Michael Keen Butterworth & Company Karen Sparck Jones All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, including photocopying and recording, without the written permission of the copyright holder, application for which should be addressed to the Publishers. Such written permission must also be obtained before any part of this publication is stored in a retrieval system of any nature. References 155 19. SPARCK JONES, K. and BATES, R. 6. Research on Automatic Indexing J974[OCRerr]J976, 2 Vols, British Library Research and Development Report 5464, Computer Laboratory, University of Cambridge (1977) 20. AITCHISON, T. M., LAVELLE, K. H. and HALL, A. M. Laboratory' Ei'aluation of Printed Subject Indexes, Part J: Design and Methodology; Part 2: Results and Discussion of Methodology, Reports R70/5, R73/17, INSPEC, Institution of Electrical Engineers, London (1970, 1973) 21. HUNT, R. et al. PRECIS, LCSH and KWOC: Report of a Research Project Designed to Examine the Applicability ofPRECIS to the Subject Catalogue ofan Academic Library, 4 parts, University of Wollongong, New South Wales (1978) 22. KEEN, E. M. Review of HUNT, R. et al., The Wollongong University Subject Catalogue Study (WUSCS), Journal of Documentation 34, 356357 (1978) 23. CLEVERDON, C. W. The Cranfield hypotheses, Library' Quarter4i' 35, l2l[OCRerr]l24 (1965) 24. LESK, M. E. and SALTON, G. Design Criteriajor Automatic Jnjormation Sj'stems, Report ISR- 11, Section VI, Cornell University, Department of Computer Science (1966) 25. CLEVERnoN, C. W. Information and its retrieval, Aslib Proceedings 22, 538[OCRerr]549 (1970) 26. SPARCK JONES, K. Does indexing exhaustivity matter?, Journal of the American SocicUjor Information Science 24, 3l3[OCRerr]3l6 (1973) 27 CLEVERDON, C. W. On the inverse relationship of recall and precision, Journal of Documentation 28, 195-201(1972) 28. LANCASTER, F. W F[OCRerr]'aluation [OCRerr]f the MEDLARS Demand Search Scoice, National Library of Medicine, Bethesda, Maryland (1968) 29. TORR, D. V., FRIED, C. and PREVEL, J. J. Program of Studies on the Use of Published Indexes, 2 parts, General Electric Company, Information Systems Operation, PB 169416 and PB 169417 (1966) 30. SPARCK JONES, K. Performance averaging for recall and precision, Journal oI[OCRerr]In!ormatics 2, 95-105 (1978) 31. KEEN, F. M. and WHEATLEY, A. Statistics and the EPSILON tests. In: E"aluation ofPrinted Subject Indexes by Laboratory IniVstigation, British Library Research and Development Report 5454, College of Librarianship Wales, Aherystwyth (1978)