SP500207 NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1) Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman ;u'ts - City University, London Summary Statistics ] Run number citymi-full, manual 1 Recall- Precision Curve Num[OCRerr]queries 50 1 Total number of documents over all queries Retrieved 9898 0.8. Relevant 16400 Rel[OCRerr]ret 3042 0.6 - b[OCRerr]ecall Level Averages Document Level_Averages Precision all Precision Recall Precision 0.4 0 0.7813 at 5 docs 0.0129 0.5760 0 0.4481 at 15 docs 0.0328 0.5000 0.2 0 0.2399 at 30 docs 0.0593 0.4573 0 0.0938 at 100 docs 0.1514 0.3818 0 0.0506 at 200 docs 0.2224 0.3042 0 0 0.0425 0 0.0166 ROC Averages False Alarm Detection 0 0.0154 0 0.0147 0.00000 0.0525 0 0.0133 0.00001 0.0735 0 0.0000 0.00002 0.0940 0.00003 0.1097 for all points 0.00004 0.1243 Avg 0.1560 J 0.00005 0.1360 ge precision for 3 0.00006 0.1456 iediate points 0.00007 0.1565 0.00008 0.1631 I 0.00009 0.1715 0.50, 0.80) [OCRerr]vg 0.0990 0 0.2 0.4 0.6 0. Recall NORMAL DEVIATE - Detection-False Alarm 0. `01 0.02 3 0 -1 -2 -3 0.16 ( 5 C ). I I I I 0.84 0.98 0.1 -3 -2 -1 0 2