SP500207 NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1) Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman suits - GTE Laboratories Summary Statistics Run number fairsi-category B, automatic 1 Num[OCRerr]queries 25 Total number of documents over all queries Retrieved 5000 0.8 Relevant 3766 Rel[OCRerr]ret 1124 0.6 Precision ecall Level Averages Document Level Averages Precision Recall Precision 0.4 () 0.7339 at 5 docs 0.0370 0.4560 () 0.4871 at 15 docs 0.0918 0.4480 0.2 0 0.3661 at 30 docs 0.1514 0.4200 0 0.2942 at 100 docs 0.3166 0.3136 0 0.2256 at 200 docs 0.4206 0.2248 0 0 0.1707 ROC Averages 0 0.0639 False Alarm Detection 0 0.0352 0.00000 0.0641 0 0.0208 0.00001 0.0853 0 0.0128 0.00002 0.1094 0 0.0000 0.00003 0.1166 ge precision for all points 0.00004 0.1299 Avg 0.2191 0.00005 0.1419 ge precision for 3 0.00006 0.1599 iediate points 0.00007 0.1532 0.50, 0.80) 0.00008 0.1732 [OCRerr]vg 0.1858 0.00009 0.1834 Recall- Precision Curve 0 0.2 0.4 0.6 Recall NORMAL DEVIATE- Detection-False Alarm 0.001 0.02 3 0.16 I I y 2 1 ½ 0 -1 5 0.84 0.98 0.[OCRerr] -w -2 -3 3 -2 -1 0 1 2 [OCRerr]