IRE Information Retrieval Experiment Contents contents Butterworth & Company Karen Sparck Jones All rights reserved. No part of this publication may be reproduced or transmitted in any form or by any means, including photocopying and recording, without the written permission of the copyright holder, application for which should be addressed to the Publishers. Such written permission must also be obtained before any part of this publication is stored in a retrieval system of any nature. viii Contents Part 3 Actual tests 211 Chapter 12 Retrieval system tests 1958-1978 213 Karen Sparck Jones 13 The Cranfield tests 256 Karen Sparck Jones 14 An experiment: search strategy variations in SDI profiles 285 Lynn Evans 15 The Smart environment for retrieval system evalua- tion-advantages and problem areas 316 Gerard Salton Bibliography 330 Index 343