Coreference Scores

University of Durham Summary
University of Manitoba System 1 Summary
University of Manitoba System 2 Summary
University of Pennsylvania System 1 Summary
University of Pennsylvania System 2 Summary
University of Sheffield Summary

OKI Summary Scores

                  Key   Rsp
Document No.      Cls   Cls           Recall                  Precision       f

9601080668         17     9      28 / 63     44.4        28 / 35     80.0   57.1
9601160264         38    26      23 / 128    18.0        23 / 84     27.4   21.7
9601260277         15    11      14 / 61     23.0        14 / 34     41.2   29.5
9602260421         13     7      14 / 44     31.8        14 / 18     77.8   45.2
9602290649         16     6       5 / 47     10.6         5 / 10     50.0   17.5
9603100074         20    14      43 / 87     49.4        43 / 52     82.7   61.9
9604040410         16    14      19 / 53     35.8        19 / 43     44.2   39.6
9604050312         18    13       8 / 45     17.8         8 / 18     44.4   25.4
9604300432         13    10      24 / 54     44.4        24 / 29     82.8   57.8
9605130706         23    11       6 / 54     11.1         6 / 15     40.0   17.4
9605200107         19    11      18 / 69     26.1        18 / 31     58.1   36.0
9605210576         22    11      32 / 70     45.7        32 / 37     86.5   59.8
9606040610         30    15      19 / 76     25.0        19 / 25     76.0   37.6
9606250230         19    10      28 / 88     31.8        28 / 29     96.6   47.9
9607160682         13     9       8 / 34     23.5         8 / 18     44.4   30.8
9607190256         20    17      27 / 77     35.1        27 / 42     64.3   45.4
9608080354         22     7       8 / 56     14.3         8 / 12     66.7   23.5
9608210097         23     6       6 / 58     10.3         6 / 13     46.2   16.9
9609100378         33    18      26 / 79     32.9        26 / 47     55.3   41.3
9609100495         15     6       7 / 37     18.9         7 / 7     100.0   31.8

TOTALS:           405   231     363 / 1280   28.4%      363 / 599    60.6%  38.6%

Go to Top of Page

University of Durham Summary Scores

                  Key   Rsp
Document No.      Cls   Cls           Recall                  Precision       f

9601080668         17    17      43 / 63     68.3        43 / 59     72.9   70.5
9601160264         38    47      47 / 128    36.7        47 / 133    35.3   36.0
9601260277         16    17      35 / 61     57.4        35 / 51     68.6   62.5
9602260421         13    15      18 / 44     40.9        18 / 39     46.2   43.4
9602290649         16    26      18 / 47     38.3        18 / 43     41.9   40.0
9603100074         20    21      53 / 86     61.6        53 / 68     77.9   68.8
9604040410         16    19      31 / 53     58.5        31 / 43     72.1   64.6
9604050312         18    19      13 / 45     28.9        13 / 36     36.1   32.1
9604300432         13    17      28 / 54     51.9        28 / 40     70.0   59.6
9605130706         23    23      12 / 53     22.6        12 / 33     36.4   27.9
9605200107         19    23      23 / 69     33.3        23 / 51     45.1   38.3
9605210576         22    23      43 / 71     60.6        43 / 59     72.9   66.2
9606040610         30    32      33 / 76     43.4        33 / 49     67.3   52.8
9606250230         20    26      55 / 88     62.5        55 / 84     65.5   64.0
9607160682         13    12      10 / 33     30.3        10 / 21     47.6   37.0
9607190256         22    33      37 / 79     46.8        37 / 70     52.9   49.7
9608080354         22    20      26 / 56     46.4        26 / 45     57.8   51.5
9608210097         24    21      23 / 59     39.0        23 / 40     57.5   46.5
9609100378         33    36      36 / 79     45.6        36 / 63     57.1   50.7
9609100495         15    14      17 / 37     45.9        17 / 27     63.0   53.1

TOTALS:           410   461     601 / 1281   46.9%      601 / 1054   57.0%  51.5%

Go to Top of Page

University of Manitoba System 1 Summary Scores

                  Key   Rsp
Document No.      Cls   Cls           Recall                  Precision       f

9601080668         17    18      46 / 63     73.0        46 / 64     71.9   72.4
9601160264         38    41      86 / 129    66.7        86 / 132    65.2   65.9
9601260277         17    20      42 / 63     66.7        42 / 57     73.7   70.0
9602260421         13    19      28 / 44     63.6        28 / 50     56.0   59.6
9602290649         17    28      18 / 49     36.7        18 / 48     37.5   37.1
9603100074         20    19      58 / 88     65.9        58 / 71     81.7   73.0
9604040410         17    25      34 / 56     60.7        34 / 58     58.6   59.6
9604050312         18    25      17 / 45     37.8        17 / 37     45.9   41.5
9604300432         13    18      30 / 54     55.6        30 / 48     62.5   58.8
9605130706         23    29      24 / 54     44.4        24 / 41     58.5   50.5
9605200107         19    27      37 / 70     52.9        37 / 70     52.9   52.9
9605210576         22    30      55 / 71     77.5        55 / 74     74.3   75.9
9606040610         30    33      41 / 76     53.9        41 / 55     74.5   62.6
9606250230         20    22      52 / 88     59.1        52 / 72     72.2   65.0
9607160682         13    14      14 / 33     42.4        14 / 22     63.6   50.9
9607190256         22    25      42 / 80     52.5        42 / 77     54.5   53.5
9608080354         22    16      28 / 56     50.0        28 / 43     65.1   56.6
9608210097         24    20      28 / 58     48.3        28 / 44     63.6   54.9
9609100378         33    38      43 / 79     54.4        43 / 91     47.3   50.6
9609100495         15    14      20 / 37     54.1        20 / 31     64.5   58.8

TOTALS:           413   481     743 / 1293   57.5%      743 / 1185   62.7%  60.0%

Go to Top of Page

University of Manitoba System 2 Summary Scores

                  Key   Rsp
Document No.      Cls   Cls           Recall                  Precision       f

9601080668         17    18      46 / 63     73.0        46 / 64     71.9   72.4
9601160264         38    41      87 / 129    67.4        87 / 133    65.4   66.4
9601260277         17    20      42 / 63     66.7        42 / 57     73.7   70.0
9602260421         13    18      28 / 44     63.6        28 / 48     58.3   60.9
9602290649         17    27      21 / 49     42.9        21 / 48     43.8   43.3
9603100074         20    19      58 / 88     65.9        58 / 71     81.7   73.0
9604040410         17    25      34 / 56     60.7        34 / 56     60.7   60.7
9604050312         18    24      17 / 45     37.8        17 / 36     47.2   42.0
9604300432         13    18      31 / 54     57.4        31 / 47     66.0   61.4
9605130706         23    28      24 / 54     44.4        24 / 41     58.5   50.5
9605200107         19    29      37 / 70     52.9        37 / 66     56.1   54.4
9605210576         22    29      55 / 71     77.5        55 / 73     75.3   76.4
9606040610         30    33      41 / 76     53.9        41 / 55     74.5   62.6
9606250230         20    21      53 / 88     60.2        53 / 71     74.6   66.7
9607160682         13    13      16 / 33     48.5        16 / 22     72.7   58.2
9607190256         22    25      44 / 80     55.0        44 / 77     57.1   56.1
9608080354         22    16      28 / 56     50.0        28 / 43     65.1   56.6
9608210097         24    20      28 / 58     48.3        28 / 44     63.6   54.9
9609100378         33    37      43 / 79     54.4        43 / 90     47.8   50.9
9609100495         15    14      20 / 37     54.1        20 / 31     64.5   58.8

TOTALS:           413   475     753 / 1293   58.2%      753 / 1173   64.2%  61.1%

Go to Top of Page

University of Pennsylvania System 1 Summary Scores

                  Key   Rsp
Document No.      Cls   Cls           Recall                  Precision       f

9601080668         17     8      36 / 63     57.1        36 / 162    22.2   32.0
9601160264         38    21      71 / 129    55.0        71 / 291    24.4   33.8
9601260277         18     5      43 / 65     66.2        43 / 139    30.9   42.2
9602260421         14     9      16 / 45     35.6        16 / 118    13.6   19.6
9602290649         17     6      20 / 47     42.6        20 / 141    14.2   21.3
9603100074         20     2      73 / 88     83.0        73 / 170    42.9   56.6
9604040410         18     6      28 / 58     48.3        28 / 154    18.2   26.4
9604050312         18     5      17 / 45     37.8        17 / 166    10.2   16.1
9604300432         13     5      26 / 54     48.1        26 / 102    25.5   33.3
9605130706         23     4      33 / 57     57.9        33 / 184    17.9   27.4
9605200107         19    16      34 / 71     47.9        34 / 198    17.2   25.3
9605210576         22     4      44 / 71     62.0        44 / 154    28.6   39.1
9606040610         30     3      49 / 76     64.5        49 / 175    28.0   39.0
9606250230         20     7      42 / 90     46.7        42 / 164    25.6   33.1
9607160682         13     3      21 / 34     61.8        21 / 79     26.6   37.2
9607190256         23    10      43 / 82     52.4        43 / 203    21.2   30.2
9608080354         22     9      21 / 56     37.5        21 / 164    12.8   19.1
9608210097         24    15      22 / 59     37.3        22 / 132    16.7   23.0
9609100378         33    10      36 / 79     45.6        36 / 231    15.6   23.2
9609100495         15     6      11 / 38     28.9        11 / 86     12.8   17.7

TOTALS:           417   154     686 / 1307   52.5%      686 / 3213   21.4%  30.4%

Go to Top of Page

University of Pennsylvania System 2 Summary Scores

                  Key   Rsp
Document No.      Cls   Cls           Recall                  Precision       f

9601080668         17    17      41 / 63     65.1        41 / 55     74.5   69.5
9601160264         38    39      72 / 127    56.7        72 / 92     78.3   65.8
9601260277         15    21      32 / 61     52.5        32 / 38     84.2   64.6
9602260421         13    13      22 / 44     50.0        22 / 27     81.5   62.0
9602290649         16    16      16 / 47     34.0        16 / 25     64.0   44.4
9603100074         20    20      43 / 86     50.0        43 / 49     87.8   63.7
9604040410         16    16      26 / 55     47.3        26 / 30     86.7   61.2
9604050312         18    19      14 / 45     31.1        14 / 27     51.9   38.9
9604300432         13    16      21 / 54     38.9        21 / 27     77.8   51.9
9605130706         23    16      17 / 53     32.1        17 / 23     73.9   44.7
9605200107         19    21      26 / 69     37.7        26 / 39     66.7   48.1
9605210576         22    21      46 / 70     65.7        46 / 51     90.2   76.0
9606040610         30    21      26 / 76     34.2        26 / 31     83.9   48.6
9606250230         19    15      49 / 88     55.7        49 / 51     96.1   70.5
9607160682         13    10       8 / 33     24.2         8 / 16     50.0   32.7
9607190256         21    20      34 / 78     43.6        34 / 50     68.0   53.1
9608080354         22    15      23 / 56     41.1        23 / 31     74.2   52.9
9608210097         23    18      26 / 58     44.8        26 / 33     78.8   57.1
9609100378         33    25      40 / 79     50.6        40 / 54     74.1   60.2
9609100495         15    10      17 / 37     45.9        17 / 19     89.5   60.7

TOTALS:           406   369     599 / 1279   46.8%      599 / 768    78.0%  58.5%

Go to Top of Page

University of Sheffield Summary Scores

                  Key   Rsp
Document No.      Cls   Cls           Recall                  Precision       f

9601080668         17    19      43 / 63     68.3        43 / 58     74.1   71.1
9601160264         38    49      80 / 128    62.5        80 / 128    62.5   62.5
9601260277         16    17      48 / 61     78.7        48 / 58     82.8   80.7
9602260421         13    15      27 / 44     61.4        27 / 35     77.1   68.4
9602290649         16    20      17 / 47     36.2        17 / 28     60.7   45.3
9603100074         20    22      52 / 87     59.8        52 / 68     76.5   67.1
9604040410         16    18      35 / 55     63.6        35 / 42     83.3   72.2
9604050312         18    21      10 / 45     22.2        10 / 34     29.4   25.3
9604300432         13    14      31 / 54     57.4        31 / 40     77.5   66.0
9605130706         23    28      19 / 55     34.5        19 / 37     51.4   41.3
9605200107         19    28      30 / 70     42.9        30 / 53     56.6   48.8
9605210576         22    31      49 / 71     69.0        49 / 70     70.0   69.5
9606040610         30    26      43 / 76     56.6        43 / 51     84.3   67.7
9606250230         19    24      56 / 88     63.6        56 / 71     78.9   70.4
9607160682         13    14      14 / 33     42.4        14 / 25     56.0   48.3
9607190256         21    28      45 / 79     57.0        45 / 72     62.5   59.6
9608080354         22    21      27 / 56     48.2        27 / 38     71.1   57.4
9608210097         23    20      28 / 58     48.3        28 / 37     75.7   58.9
9609100378         33    36      48 / 79     60.8        48 / 75     64.0   62.3
9609100495         15    17      19 / 37     51.4        19 / 28     67.9   58.5

TOTALS:           407   468     721 / 1286   56.1%      721 / 1048   68.8%  61.8%

Go to Top of Page


For more website information contact: Ellen Voorhees
For more evaluation information contact: Nancy Chinchor
Last updated: Tuesday, 08-Mar-2005 15:19:36 EST
Date created: Friday, 12-Jan-01