IRE
Information Retrieval Experiment
Retrieval system tests 1958-1978
chapter
Karen Sparck Jones
Butterworth & Company
Karen Sparck Jones
All rights reserved. No part of this publication may be reproduced
or transmitted in any form or by any means, including photocopying
and recording, without the written permission of the copyright holder,
application for which should be addressed to the Publishers. Such
written permission must also be obtained before any part of this
publication is stored in a retrieval system of any nature.
Approaches to the historical review 217
Test
System
I I
[OCRerr]periment : Investigation
I I
I I
I I
I-------------------------------------------------------J
13
Ii I
Ii I I
13 Core
II
13 I
I 3 I
1L-------------------------------------------------------------------------------I
I I
II I I
II
11periphery I
II
II------------------------------------------------------------------------------J
-- I I
Figure 12.1
Test
I------------------------------------------------------------------------------
I I
I I
I I
I 1EXperirnert Investigation
I I
--------------------------------------------------------------------------------
L--------------------------------------------------------------------------------
II 3//////////// ;/ I I I I I / I
IIIIIIIIIIII `I I I I I I I I
Core lIl/IllIllIll 1/ / I I I I I I
I I/I/I//I/I/I `I I I I I I I I
31 I
II IIIIII/I/IIII Il I I I I I I I
System ;L-------------------------------------------------------------------------------I
II I I
I'' [OCRerr] [OCRerr] [OCRerr] `[OCRerr] I I I
II
Ii 1/ I I I I I g I I I I
ii Periphery I I I I I I I I I I
II
II `I I I I I I I I I I I
I I
Il I I I I I I I I I
I I
Figure 12.2
1968-1978, and the two will therefore be treated separately. In conclijsion, I
shall consider the status that experimental work in retrieval as a whole has
achieved, and its wider impact, especially on operational systems.
Thus summarizing the discussion so far, we have testing ranging from
experiment proper to investigation, and system phenomena ranging from
core to periphery. Setting the one against the other gives us Figure 12.1. We
then superimpose the concern with system function, which we can represent
by shading, so we get Figure 12.2. The main focus of the chapter is therefore
with the most densely shaded area of the diagram: evaluation experiment.
However, as the boundaries are not absolute, some reference to the broader
picture will be made, but only as far as this is justified by the need for a broad
historical account.
In describing and relating the various tests, some simplification is