SP500207 NIST Special Publication 500-207: The First Text REtrieval Conference (TREC-1) Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Lilts - GE Research and Development Center I Summary Statistics Run number gecrdl-full, manual 1 Num[OCRerr]queries 50 Total number of documents over all queries Retrieved 7365 Relevant 16400 Rel[OCRerr]ret 3363 Precision ecall Level Averages Document Level Averages Precision Recall Precision 0.4 0 0.8682 at 5 docs 0.0164 0.6640 0 0.5258 at 15 docs 0.0413 0.6107 0.2 0 0.3154 at 30 docs 0.0725 0.5593 0 0.1562 at 100 docs 0.1813 0.4508 0 0.1196 at 200 docs 0.2452 0.3363 0 0 0.0522 ROC Averages 0 0.0395 False Alarm Detection 0 0.0112 0.00000 0.0824 0 0.0000 0.00001 0.1065 0 0.0000 0.00002 0.1352 0 0.0000 0.00003 0.1554 ,[OCRerr]ecision for all points 1 0.00004 0.1698 Avg 0.1898 0.00005 0.1831 ge precision for 3 0.00006 0.1933 [OCRerr]diate points 0.00007 0.2002 0.50, 0.80) 0.00008 0.2089 [OCRerr]vg 0.1226 0.00009 0.2166 ] 0.8 1 0.6 Recall-Precision Curve 0 0.2 0.4 0.6 0. Recall NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 0.16 0.5 3 2 1 0 -1 0.84 0.98 0. <½' -77 -2 -3 I I I I .3 -2 -1 0 1 2