SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman ilts - Belicore Summary Statistics Run number IsiacOl-full, automatic Num[OCRerr]queries 50 Total number of documents over all queries Retrieved 9995 Relevant 16400 { Rel[OCRerr]ret 2786 [OCRerr]call Level Averages Lil Precision 0 0.6864 0 0.3808 0 0.1926 0 0.0924 0 0.0391 0 0.0104 0 0.0000 0 0.0000 0 0.0000 0 0.0000 `0 0.0000 ,[OCRerr][OCRerr]ecision for all points Avg 0.1274 [OCRerr]e precision for 3 riediate points 0.50, 0.80) Avg 0.0677 1 Document Level Averages 1 0.8 - 0.6 Precision 0.4 Recall Precision at 5 docs 0.0096 0.4640 at 15 docs 0.0243 0.4107 0.2 at 30 docs 0.0458 0.3967 at 100 docs 0.1247 0.3446 0 at 200 docs 0.1983 0.2786 Recall- Precision Curve 0 0.2 0.4 0.6 ROC Averages Recall False Alarm Detection 0.00000 0.0393 0.00001 0.0559 0 3 0.00002 0.0729 0.00003 0.0867 2 0.00004 0.0988 0.00005 0.1092 1 0.00006 0.1196 0.00007 0.1283. 0.00008 0.1357 0 0.00009 0.1442 -1 2 .3 NORMAL DEVIATE - Detection-False Alarm .001 0.02 0.16 0.5 0.84 0.98 0. I I I -3 -2 -1 0 1 2