SP500207 NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1) Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Lilts - Beilcore Summary Statistics 1 Recall-Precision Curve Run number IsircOl-full, automatic 1 Num4ueries 50 j Total number of documents over all queries 1 0.8 - Retrieved j 10000 1 Relevant 15459 Rel[OCRerr]ret 2234 0.6 Precision call Level Averages Document Level Averages 0.4 1 Precision Recall Precision 0.6323 at 5 docs 0.0106 0.4160 0.3061 at 15 docs 0.0286 0.3893 0.2 0.1901 at 30 docs 0.0506 0.3573 0.0883 at 100 docs 0.1273 0.3024 0 0.0370 at 200 docs 0.1847 0.2234 0.0077 ROC Averages 0.0000 False Alarm Detection 0.0000 0.00000 0.0418 0.0000 0.00001 0.0513 0.0000 0.00002 0.0719 0.0000 0.00003 0.0828 e precision for all points 0.00004 0.0977 [OCRerr]vg 0.1147 I 0.00005 0.1069 e precision for 3 0.00006 0.1170 ediate points 0.00007 0.1259 ).50, 0.80) 0.00008 0.1312 vg 0.0659 0.00009 0.1389 _ A- 0.8 0 0.2 0.4 0.6 Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 0.16 0.5 0.84 0.98 0.9[OCRerr] 3 I I 2 1 0 -1 -2 -3 ½½1 -3 -2 -1 0 2 3