SP500207 Appendix A: TREC-1 Results appendix National Institute of Standards and Technology Donna K. Harman Ilts - Cornell University L Summary Statistics Run number crnla2-full, automatic 1 Num[OCRerr]queries 50 Total number of documents over all queries 0.8 Retrieved 10000 Relevant 16400 Rel[OCRerr]ret 3345 0.6 - ecall Level Averages Precision 0 0.7367 0 0.4506 0 0.2803 0 0.1945 0 0.1102 0 0.0714 0 0.0357 0 0.0229 0 0.0095 0 0.0000 0 0.0000 L[OCRerr]ecision for all points 1 Avg 0.1738 tge precision for 3 nediate points I 0.50, 0.80) Avg 0.1204 Precision Document Level Averages 0.4 Recall Precision at 5 docs 0.0123 0.5120 at 15 docs 0.0337 0.4773 0.2 at 30 docs 0.0613 0.4400 at 100 docs 0.1661 0.3972 0 at 200 docs 0.2572 0.3345 Recall-Precision Curve 0 0.2 0.4 0.6 ROC Averages Recall False Alarm Detection 0.00000 0.0624 0.00001 0.0945 0.00002 0.1143 0.00003 0.1340 0.00004 0.1498 0.00005 0.1608 0.00006 0.1737 0.00007 0.1854 0.00008 0.1940 0.00009 0.2025 NORMAL DEVIATE - Detection-False Alarm 0.001 0.02 3 2 1 0 -1 -2 0.16 0.5 0.84 0.98 0. 7 -3 I I I .3 -2 -1 0 2