Template Relation Scores

BBN Summary
OKI Summary
SRA International, Inc. Summary
University of Sheffield Summary

American University of Cairo Summary Scores

------------------------------------------------------------------------------
               POS   ACT| COR PAR INC | MIS  SPU  NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES          |             |              |                        
entity                  |             |              |
 artifact       62     0|   0   0    0|  62    0   10|   0   0 100   0   0 100
 organizatio   479   116| 114   0    2| 363    0   36|  24  98  76   0   2  76
 person        361    95|  94   0    0| 267    1    3|  26  99  74   1   0  74
location                |             |              |
 airport         6     1|   0   0    1|   5    0    2|   0   0  83   0 100 100
 city          116     9|   5   0    4| 107    0    2|   4  56  92   0  44  96
 country        97    11|  10   0    0|  87    1    4|  10  91  90   9   0  90
 province       12     4|   2   0    2|   8    0   13|  17  50  67   0  50  83
 region         10     0|   0   0    0|  10    0    1|   0   0 100   0   0 100
 unk             0     0|   0   0    0|   0    0    0|   0   0   0   0   0   0
 water           1     0|   0   0    0|   1    0    0|   0   0 100   0   0 100
------------------------+-------------+--------------+------------------------
OBJ SCORES              |             |              |
location       242    25|  20   0    4| 218    1    7|   8  80  90   4  17  92
entity         902   243| 208   0   34| 660    1   49|  23  86  73   0  14  77
location_of    240    25|  20   0    4| 216    1   76|   8  80  90   4  17  92
product_of      57     0|   0   0    0|  57    0   24|   0   0 100   0   0 100
employee_of    343   115| 105   0    7| 231    3   56|  31  91  67   3   6  70
------------------------+-------------+--------------+------------------------
SLOT SCORES             |             |              |
location                |             |              |
 locale        242    25|  14   0   10| 218    1    8|   6  56  90   4  42  94
 locale_type   242    25|  17   0    7| 218    1   22|   7  68  90   4  29  93
 country       241    25|  12   0   12| 217    1   11|   5  48  90   4  50  95
 obj_status      0     0|   0   0    0|   0    0    7|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   35|   0   0   0   0   0   0
entity                  |             |              |
 ent_name     1145   208| 166   0   38| 941    4   45|  14  80  82   2  19  86
 ent_type      902   211| 208   0    2| 692    1   49|  23  99  77   0   1  77
 ent_descrip   415    22|   2   0    9| 404   11  352|   0   9  97  50  82 100
 ent_categor   902   211| 128   0   82| 692    1   54|  14  61  77   0  39  86
 obj_status      0     0|   0   0    0|   0    0   56|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   67|   0   0   0   0   0   0
location_of             |             |              |
 location      240    25|  19   0    5| 216    1   76|   8  76  90   4  21  92
 organizatio   239    24|   9   0   14| 216    1   77|   4  38  90   4  61  96
 obj_status      0     0|   0   0    0|   0    0   54|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   23|   0   0   0   0   0   0
product_of              |             |              |
 artifact       57     0|   0   0    0|  57    0   24|   0   0 100   0   0 100
 organizatio    57     0|   0   0    0|  57    0   24|   0   0 100   0   0 100
 obj_status      0     0|   0   0    0|   0    0   13|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0    6|   0   0   0   0   0   0
employee_of             |             |              |
 person        343   115|  89   0   23| 231    3   56|  26  77  67   3  21  74
 organizatio   342   114|  90   0   21| 231    3   59|  26  79  68   3  19  74
 obj_status      0     0|   0   0    0|   0    0   40|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   16|   0   0   0   0   0   0
------------------------+-------------+--------------+------------------------
ALL SLOTS     5367  1007| 754   0  223|4390   30 1174|  14  75  82   3  23  86
                                                    P&R      2P&R      P&2R
F-MEASURES                                        23.66     40.13     16.77
Go to Top of Page

BBN Summary Scores

------------------------------------------------------------------------------
               POS   ACT| COR PAR INC | MIS  SPU  NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES          |             |              |                        
entity                  |             |              |
 artifact       65    45|  35   0    5|  25    5    7|  54  78  38  11  13  50
 organizatio   504   428| 392   0   17|  95   19   11|  78  92  19   4   4  25
 person        362   302| 275   0   11|  76   16    2|  76  91  21   5   4  27
location                |             |              |
 airport         6     1|   0   0    1|   5    0    2|   0   0  83   0 100 100
 city          117    87|  68   0   11|  38    8    1|  58  78  32   9  14  46
 country        99    66|  49   0   11|  39    6    2|  49  74  39   9  18  53
 province       12     9|   7   0    0|   5    2   13|  58  78  42  22   0  50
 region         10     6|   2   0    2|   6    2    1|  20  33  60  33  50  83
 unk             0     0|   0   0    0|   0    0    0|   0   0   0   0   0   0
 water           1     0|   0   0    0|   1    0    0|   0   0 100   0   0 100
------------------------+-------------+--------------+------------------------
OBJ SCORES              |             |              |
location       245   169| 139   0   12|  94   18    4|  57  82  38  11   8  47
entity         931   775| 703   0   32| 196   40   20|  76  91  21   5   4  28
location_of    259   186| 159   0    6|  94   21   57|  61  85  36  11   4  43
product_of      66    50|  33   0    5|  28   12   15|  50  66  42  24  13  58
employee_of    355   311| 282   0    2|  71   27   44|  79  91  20   9   1  26
------------------------+-------------+--------------+------------------------
SLOT SCORES             |             |              |
location                |             |              |
 locale        245   169| 112   0   39|  94   18    5|  46  66  38  11  26  57
 locale_type   245   169| 126   0   25|  94   18   19|  51  75  38  11  17  52
 country       244   169| 126   0   25|  93   18    8|  52  75  38  11  17  52
 obj_status      0     0|   0   0    0|   0    0    7|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   35|   0   0   0   0   0   0
entity                  |             |              |
 ent_name     1166   919| 750   0   91| 325   78   24|  64  82  28   8  11  40
 ent_type      931   775| 702   0   33| 196   40   20|  75  91  21   5   4  28
 ent_descrip   433   302| 198   0   52| 183   52  334|  46  66  42  17  21  59
 ent_categor   931   775| 663   0   72| 196   40   25|  71  86  21   5  10  32
 obj_status      0     0|   0   0    0|   0    0   56|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   67|   0   0   0   0   0   0
location_of             |             |              |
 location      257   184| 142   0   21|  94   21   59|  55  77  37  11  13  49
 organizatio   258   185| 127   0   37|  94   21   58|  49  69  36  11  23  54
 obj_status      0     0|   0   0    0|   0    0   54|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   23|   0   0   0   0   0   0
product_of              |             |              |
 artifact       65    49|  30   0    7|  28   12   16|  46  61  43  24  19  61
 organizatio    66    50|  25   0   13|  28   12   15|  38  50  42  24  34  68
 obj_status      0     0|   0   0    0|   0    0   13|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0    6|   0   0   0   0   0   0
employee_of             |             |              |
 person        355   311| 273   0   11|  71   27   44|  77  88  20   9   4  29
 organizatio   355   311| 260   0   24|  71   27   46|  73  84  20   9   8  32
 obj_status      0     0|   0   0    0|   0    0   40|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   16|   0   0   0   0   0   0
------------------------+-------------+--------------+------------------------
ALL SLOTS     5551  4372|3534   0  450|1567  388  990|  64  81  28   9  11  40
                                                    P&R      2P&R      P&2R
F-MEASURES                                        71.23     76.70     66.49
Go to Top of Page

OKI Summary Scores

------------------------------------------------------------------------------
               POS   ACT| COR PAR INC | MIS  SPU  NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES          |             |              |                        
entity                  |             |              |
 artifact       62     9|   1   0    5|  56    3   10|   2  11  90  33  83  98
 organizatio   495   379| 336   0   18| 141   25   20|  68  89  28   7   5  35
 person        362   298| 265   0   17|  80   16    2|  73  89  22   5   6  30
location                |             |              |
 airport         6     5|   0   0    5|   1    0    2|   0   0  17   0 100 100
 city          118    97|   3   0   94|  21    0    0|   3   3  18   0  97  97
 country        97    81|   0   0   81|  16    0    4|   0   0  16   0 100 100
 province       12    13|   0   0   11|   1    2   13|   0   0   8  15 100 100
 region         10     4|   0   0    4|   6    0    1|   0   0  60   0 100 100
 unk             0   154|   0   0    0|   0  154    0|   0   0   0 100   0 100
 water           1     5|   1   0    0|   0    4    0| 100  20   0  80   0  80
------------------------+-------------+--------------+------------------------
OBJ SCORES              |             |              |
location       244   359| 157   0   42|  45  160    5|  64  44  18  45  21  61
entity         919   686| 603   0   39| 277   44   32|  66  88  30   6   6  37
location_of    240    48|  34   0    4| 202   10   76|  14  71  84  21  11  86
product_of      57     1|   0   0    0|  57    1   24|   0   0 100 100   0 100
employee_of    338    22|  22   0    0| 316    0   61|   7 100  93   0   0  93
------------------------+-------------+--------------+------------------------
SLOT SCORES             |             |              |
location                |             |              |
 locale        244   360| 103   0   96|  45  161    6|  42  29  18  45  48  75
 locale_type   244   359|   4   0  195|  45  160   20|   2   1  18  45  98  99
 country       243   359|  98   0  100|  45  161    9|  40  27  19  45  51  76
 obj_status      0     0|   0   0    0|   0    0    7|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   35|   0   0   0   0   0   0
entity                  |             |              |
 ent_name     1159   795| 485   0  232| 442   78   31|  42  61  38  10  32  61
 ent_type      919   686| 602   0   40| 277   44   32|  66  88  30   6   6  37
 ent_descrip   422     1|   0   0    0| 422    1  345|   0   0 100 100   0 100
 ent_categor   919   685| 445   0  197| 277   43   37|  48  65  30   6  31  54
 obj_status      0     0|   0   0    0|   0    0   56|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   67|   0   0   0   0   0   0
location_of             |             |              |
 location      239    47|  28   0    9| 202   10   77|  12  60  85  21  24  89
 organizatio   239    47|  20   0   17| 202   10   77|   8  43  85  21  46  92
 obj_status      0     0|   0   0    0|   0    0   54|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   23|   0   0   0   0   0   0
product_of              |             |              |
 artifact       57     1|   0   0    0|  57    1   24|   0   0 100 100   0 100
 organizatio    57     1|   0   0    0|  57    1   24|   0   0 100 100   0 100
 obj_status      0     0|   0   0    0|   0    0   13|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0    6|   0   0   0   0   0   0
employee_of             |             |              |
 person        338    22|  16   0    6| 316    0   61|   5  73  93   0  27  95
 organizatio   338    22|  13   0    9| 316    0   63|   4  59  93   0  41  96
 obj_status      0     0|   0   0    0|   0    0   40|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   16|   0   0   0   0   0   0
------------------------+-------------+--------------+------------------------
ALL SLOTS     5418  3387|1814   0  901|2703  672 1123|  33  54  50  20  33  70
                                                    P&R      2P&R      P&2R
F-MEASURES                                        41.20     47.82     36.19
Go to Top of Page

SRA International, Inc. Summary Scores

------------------------------------------------------------------------------
               POS   ACT| COR PAR INC | MIS  SPU  NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES          |             |              |                        
entity                  |             |              |
 artifact       68    38|  35   0    0|  33    3    4|  51  92  49   8   0  51
 organizatio   498   401| 374   0   12| 112   15   17|  75  93  22   4   3  27
 person        361   301| 287   0    4|  70   10    3|  80  95  19   3   1  23
location                |             |              |
 airport         7     3|   1   0    1|   5    1    1|  14  33  71  33  50  88
 city          114    77|  66   0    8|  40    3    4|  58  86  35   4  11  44
 country        99    73|  66   0    2|  31    5    2|  67  90  31   7   3  37
 province       12     5|   5   0    0|   7    0   13|  42 100  58   0   0  58
 region         11     6|   4   0    1|   6    1    0|  36  67  55  17  20  67
 unk             0     0|   0   0    0|   0    0    0|   0   0   0   0   0   0
 water           1     0|   0   0    0|   1    0    0|   0   0 100   0   0 100
------------------------+-------------+--------------+------------------------
OBJ SCORES              |             |              |
location       244   164| 147   0    7|  90   10    5|  60  90  37   6   5  42
entity         927   740| 696   0   16| 215   28   24|  75  94  23   4   2  27
location_of    254   183| 162   0    6|  86   15   62|  64  89  34   8   4  40
product_of      66    40|  35   0    0|  31    5   15|  53  88  47  13   0  51
employee_of    357   313| 294   0    1|  62   18   42|  82  94  17   6   0  22
------------------------+-------------+--------------+------------------------
SLOT SCORES             |             |              |
location                |             |              |
 locale        244   164| 136   0   18|  90   10    6|  56  83  37   6  12  46
 locale_type   244   164| 142   0   12|  90   10   20|  58  87  37   6   8  44
 country       243   164| 140   0   14|  89   10    9|  58  85  37   6   9  45
 obj_status      0     0|   0   0    0|   0    0    7|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   35|   0   0   0   0   0   0
entity                  |             |              |
 ent_name     1167   918| 793   0   60| 314   65   23|  68  86  27   7   7  36
 ent_type      927   740| 696   0   16| 215   28   24|  75  94  23   4   2  27
 ent_descrip   428   352| 231   0   48| 149   73  339|  54  66  35  21  17  54
 ent_categor   927   740| 673   0   39| 215   28   29|  73  91  23   4   5  30
 obj_status      0     0|   0   0    0|   0    0   56|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   67|   0   0   0   0   0   0
location_of             |             |              |
 location      253   182| 147   0   20|  86   15   63|  58  81  34   8  12  45
 organizatio   252   181| 147   0   19|  86   15   64|  58  81  34   8  11  45
 obj_status      0     0|   0   0    0|   0    0   54|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   23|   0   0   0   0   0   0
product_of              |             |              |
 artifact       66    40|  34   0    1|  31    5   15|  52  85  47  13   3  52
 organizatio    66    40|  21   0   14|  31    5   15|  32  53  47  13  40  70
 obj_status      0     0|   0   0    0|   0    0   13|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0    6|   0   0   0   0   0   0
employee_of             |             |              |
 person        357   313| 286   0    9|  62   18   42|  80  91  17   6   3  24
 organizatio   355   311| 276   0   17|  62   18   46|  78  89  17   6   6  26
 obj_status      0     0|   0   0    0|   0    0   40|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   16|   0   0   0   0   0   0
------------------------+-------------+--------------+------------------------
ALL SLOTS     5529  4314|3722   0  287|1520  305 1012|  67  86  27   7   7  36
                                                    P&R      2P&R      P&2R
F-MEASURES                                        75.63     81.68     70.41

Go to Top of Page

University of Sheffield Summary Scores

------------------------------------------------------------------------------
               POS   ACT| COR PAR INC | MIS  SPU  NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES          |             |              |                        
entity                  |             |              |
 artifact       62     2|   0   0    2|  60    0   10|   0   0  97   0 100 100
 organizatio   483   271| 262   0    6| 215    3   32|  54  97  45   1   2  46
 person        362   209| 207   0    1| 154    1    2|  57  99  43   0   0  43
location                |             |              |
 airport         6     2|   0   0    2|   4    0    2|   0   0  67   0 100 100
 city          113    52|  36   0   16|  61    0    5|  32  69  54   0  31  68
 country        98    40|  34   0    3|  61    3    3|  35  85  62   8   8  66
 province       14    12|   9   0    2|   3    1   11|  64  75  21   8  18  40
 region         10     0|   0   0    0|  10    0    1|   0   0 100   0   0 100
 unk             0     0|   0   0    0|   0    0    0|   0   0   0   0   0   0
 water           1     0|   0   0    0|   1    0    0|   0   0 100   0   0 100
------------------------+-------------+--------------+------------------------
OBJ SCORES              |             |              |
location       242   107|  98   0    4| 140    5    7|  40  92  58   5   4  60
entity         907   482| 469   0    9| 429    4   44|  52  97  47   1   2  49
location_of    245   107| 100   0    2| 143    5   71|  41  93  58   5   2  60
product_of      57     1|   0   0    0|  57    1   24|   0   0 100 100   0 100
employee_of    349   215| 206   0    3| 140    6   50|  59  96  40   3   1  42
------------------------+-------------+--------------+------------------------
SLOT SCORES             |             |              |
location                |             |              |
 locale        242   106|  62   0   40| 140    4    8|  26  58  58   4  39  75
 locale_type   242   106|  79   0   23| 140    4   22|  33  75  58   4  23  68
 country       241   106|  88   0   14| 139    4   11|  37  83  58   4  14  64
 obj_status      0     0|   0   0    0|   0    0    7|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   35|   0   0   0   0   0   0
entity                  |             |              |
 ent_name     1151   555| 476   0   52| 623   27   39|  41  86  54   5  10  60
 ent_type      907   482| 469   0    9| 429    4   44|  52  97  47   1   2  49
 ent_descrip   418   209|  56   0   91| 271   62  349|  13  27  65  30  62  88
 ent_categor   907   482| 453   0   25| 429    4   49|  50  94  47   1   5  50
 obj_status      0     0|   0   0    0|   0    0   56|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   67|   0   0   0   0   0   0
location_of             |             |              |
 location      245   107|  86   0   16| 143    5   71|  35  80  58   5  16  66
 organizatio   243   105|  74   0   26| 143    5   73|  30  70  59   5  26  70
 obj_status      0     0|   0   0    0|   0    0   54|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   23|   0   0   0   0   0   0
product_of              |             |              |
 artifact       57     1|   0   0    0|  57    1   24|   0   0 100 100   0 100
 organizatio    57     1|   0   0    0|  57    1   24|   0   0 100 100   0 100
 obj_status      0     0|   0   0    0|   0    0   13|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0    6|   0   0   0   0   0   0
employee_of             |             |              |
 person        349   215| 194   0   15| 140    6   50|  56  90  40   3   7  45
 organizatio   344   210| 177   0   27| 140    6   57|  51  84  41   3  13  49
 obj_status      0     0|   0   0    0|   0    0   40|   0   0   0   0   0   0
 comment         0     0|   0   0    0|   0    0   16|   0   0   0   0   0   0
------------------------+-------------+--------------+------------------------
ALL SLOTS     5403  2692|2214   0  338|2851  140 1138|  41  82  53   5  13  60
                                                    P&R      2P&R      P&2R
F-MEASURES                                        54.70     68.46     45.55
Go to Top of Page


For more website information contact: Ellen Voorhees
For more evaluation information contact: Nancy Chinchor
Last updated: Tuesday, 08-Mar-2005 15:22:52 EST
Date created: Friday, 12-Jan-01