IRE Information Retrieval Experiment The Smart environment for retrieval system evaluation-advantages and problem areas chapter Gerard Salton Butterworth & Company Karen Sparck Jones All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, including photocopying and recording, without the written permission of the copyright holder, application for which should be addressed to the Publishers. Such written permission must also be obtained before any part of this publication is stored in a retrieval system of any nature. References 329 21. SALTON, G. A new comparison between conventional indexing (Medlars) and automatic text processing (Smart), Journal of the American Society for Information Science 23, 75-84 (1972) 22. CUADRA, C. A. and KATTER, R. V. Opening the black box of relevance, JournalofDocumentation 23, No.4, 251-303 (1967) 23. REES, A. M. and SCHULTZ, D. G. A Field Experimental Approach to the Study of Relevance Assessments in Relation to Document Searching, 2 Vols, Center for Documentation and Communication Research, Case Western Reserve University (1967) 24. LESK, M. E. and SALTON, G. Relevance assessments and retrieval system evaluation, Information Storage and Retrieval 4, 343-359 (1968) 25. SALTON, G. Evaluation problems in interactive information retrieval, Information Storage and Retrieval 6, 29-44 (1970) 26. SALTON, G. The evaluation of computer-based information retrieval systems, Proceedings of the FID Congress, pp. 12[OCRerr]l33, International Federation for Documentation (1965) 27. vERNIMB, C. Automatic query adjustment in document retrieval, Information Processing and Management 13, 339-353 (1977) 28. CROFr, W. B. Clustering large files of documents using the single link method, Journal of the American Society for Information Science 28, 341-344 (1977) 29. ATTAR, L. and FRAENKEL, A. 5. Local feedback in full text retrieval systems, Journal of the ACM 24, 397-417(1977) 30. DOSZKOCS, T. E. AID-an associate interactive dictionary for on-line searching, On-Line Review 2, 163-173 (1978) 31. SALTON, G., YANG, C. 5. and YU, C. T. A theory of term importance in automatic text analysis, Journal of the Amerkan Society for Information Science 26, 33[OCRerr]4 (1975) 32. SALTON, G., WONG, A. and YANG, C. 5. A vector space model for automatic indexing, Communications of the ACM 18, 613-620(1975) 33. SALTON, G., YANG, C. 5. and YU, C. T. Contributions to the theory of indexing, Information Processing 74, Proceedings of IFIP Congress (Ed. J. L. Rosenfeld), pp.584590, North- Holland, Amsterdam (1974) 34. SPARCK JONES, K. A statistical interpretation of term specificity and its application in retrieval, Journal of Documentation 28, 11-21(1972) 35. SALTON, G. and YANG, C. 5. On the specification of term values in automatic indexing, Journal ofDocumentation 29, 351-372 (1973) 36. SALTON, G. and WONG, A. On the role of words and phrases in automatic text analysis, C9rnputers and the Humanities 10, 69-87 (1976) 37. ROBERTSON, 5. E. and SPARCK JONES, K. Relevance weighting of search terms, Journal of the American Society for Information Science 27, 129-146 (1976) 38. YU, C. T. and SALTQN, G. Precision weighting-an effective automatic indexing method, Journal of the ACM 23, 7[OCRerr]88 (1976) 39. SALTON, G., WONG, A; and YU, C. T. Automatic indexing using term discrimination and term precision measureinents, Information Processing and Management 12, 43-51(1976) 40. SALTON, G. and WALDSTEJN, R. K. Term relevance weights in on-line information retrieval, Information Processing and Management 14, 29-35 (1978) 41. SALTON, G. and WONG, A. Generation and search of clustered files, ACM Transactions on Database Systems 3, 321-346 (1978) 42. YU, C. T., SALTON, G. and SIU, M. K. Effective automatic indexing using term addition and deletion, Journal of the ACM 25, 210-225 (1978) 43. WU, H. On Term Distribution, Space Density and System Performance, Department of Computer Science, Cornell University (1979) 44. DOYLE, L. B. Book review of automatic information organization and retrieval by G. Salton, Computing Reviews 10, 271-272 (1969) 45. DE SOLLA PRICE, DEREK, private communication 46. VAN RIJSBERGEN, C. J. A theoretical basis for the use of cooccurrence data in information retrieval, Journal of Documentation 33, 10[OCRerr]1 19 (1977)