SP500207
NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1)
Description of the PRC CEO Algorithm for TREC
chapter
P. Thompson
National Institute of Standards and Technology
Donna K. Harman
Top ranked evaluation
Run number: 1
Num[OCRerr]queries: 50
Total number of documents over all queries
Retrieved: 10000
Relevant: 3901
Rel ret: 1867
RecalF- Precision Averages:
at0.00 0.5419
at 0.10 0.3684
at0.20 0.3239
at0.30 0.2848
at0.40 0.1975
atOSO 0.1490
at 0.60 0.0933
at0.70 0.0575
at 0.80 0.0147
at0.90 0.0029
at 1.00 0.0006
Average precision for all points
11-ptAvg: 0.1850
Average precision for 3 intermediate points (0.20, 0.50, 0.80)
3-pt Avg: 0.1625
Recall:
Exact:
at Sdocs:
at 15 docs:
at 30 docs:
at 100 docs:
at 200 docs:
Precision:
Exact: 0.1867
At Sdocs: 0.2360
Atl5docs: 0.2920
At30docs: 0.2853
AtlOOdocs: 0.2234
At200docs: 0.1867
0.5400
0.0270
0.0890
0.1592
0.3603
0.5400
Figure 2. Post-TREC summary results with 11-point average weights
and additional relevance judgments
340