BBN Summary
FACILE Summary
Lockeed Martin Summary
New York University Summary
OKI Summary
SRA International, Inc. Summary
University of Durham Summary
University of Sheffield Summary
------------------------------------------------------------------------------
POS ACT| COR PAR INC | MIS SPU NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES | | |
entity | | |
artifact 183 30| 15 0 13| 155 2 26| 8 50 85 7 46 92
organizatio 833 500| 436 0 47| 350 17 44| 52 87 42 3 10 49
person 467 352| 323 0 6| 138 23 2| 69 92 30 7 2 34
location | | |
airport 21 8| 1 0 7| 13 0 2| 5 13 62 0 88 95
city 225 167| 145 0 15| 65 7 3| 64 87 29 4 9 38
country 259 185| 168 0 15| 76 2 8| 65 91 29 1 8 36
province 54 38| 31 0 3| 20 4 17| 57 82 37 11 9 47
region 88 32| 18 0 14| 56 0 5| 20 56 64 0 44 80
unk 33 5| 0 0 5| 28 0 3| 0 0 85 0 100 100
water 12 3| 0 0 3| 9 0 1| 0 0 75 0 100 100
------------------------+-------------+--------------+------------------------
OBJ SCORES | | |
location 692 438| 391 0 34| 267 13 19| 57 89 39 3 8 45
entity 1483 882| 781 0 59| 643 42 72| 53 89 43 5 7 49
------------------------+-------------+--------------+------------------------
SLOT SCORES | | |
location | | |
locale 696 438| 320 0 105| 271 13 25| 46 73 39 3 25 55
locale_type 692 438| 363 0 62| 267 13 39| 52 83 39 3 15 49
country 691 438| 306 0 118| 267 14 26| 44 70 39 3 28 57
obj_status 0 0| 0 0 0| 0 0 23| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 52| 0 0 0 0 0 0
entity | | |
ent_name 1725 862| 477 0 304| 944 81 64| 28 55 55 9 39 74
ent_type 1483 882| 774 0 66| 643 42 72| 52 88 43 5 8 49
ent_descrip 647 45| 0 0 20| 627 25 618| 0 0 97 56 100 100
ent_categor 1483 882| 462 0 378| 643 42 102| 31 52 43 5 45 70
obj_status 0 0| 0 0 0| 0 0 100| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 109| 0 0 0 0 0 0
------------------------+-------------+--------------+------------------------
ALL SLOTS 7417 3985|2702 0 1053|3662 230 1230| 36 68 49 6 28 65
P&R 2P&R P&2R
F-MEASURES 47.40 57.84 40.15
Go to Top of Page
------------------------------------------------------------------------------
POS ACT| COR PAR INC | MIS SPU NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES | | |
entity | | |
artifact 190 173| 118 0 24| 48 31 19| 62 68 25 18 17 47
organizatio 870 906| 830 0 13| 27 63 7| 95 92 3 7 2 11
person 468 479| 448 0 6| 14 25 1| 96 94 3 5 1 9
location | | |
airport 21 23| 20 0 0| 1 3 2| 95 87 5 13 0 17
city 226 249| 207 0 8| 11 34 2| 92 83 5 14 4 20
country 262 236| 217 0 17| 28 2 5| 83 92 11 1 7 18
province 52 58| 45 0 6| 1 7 19| 87 78 2 12 12 24
region 88 70| 52 0 15| 21 3 5| 59 74 24 4 22 43
unk 34 29| 22 0 6| 6 1 2| 65 76 18 3 21 37
water 12 15| 12 0 0| 0 3 1| 100 80 0 20 0 20
------------------------+-------------+--------------+------------------------
OBJ SCORES | | |
location 695 680| 610 0 17| 68 53 16| 88 90 10 8 3 18
entity 1528 1558|1402 0 37| 89 119 27| 92 90 6 8 3 15
------------------------+-------------+--------------+------------------------
SLOT SCORES | | |
location | | |
locale 699 683| 594 0 35| 70 54 22| 85 87 10 8 6 21
locale_type 695 680| 575 0 52| 68 53 36| 83 85 10 8 8 23
country 694 680| 559 0 67| 68 54 23| 81 82 10 8 11 25
obj_status 0 0| 0 0 0| 0 0 23| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 52| 0 0 0 0 0 0
entity | | |
ent_name 1761 1900|1512 0 134| 115 254 28| 86 80 7 13 8 25
ent_type 1528 1558|1396 0 43| 89 119 27| 91 90 6 8 3 15
ent_descrip 675 456| 346 0 63| 266 47 590| 51 76 39 10 15 52
ent_categor 1528 1558|1320 0 119| 89 119 57| 86 85 6 8 8 20
obj_status 0 0| 0 0 0| 0 0 100| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 109| 0 0 0 0 0 0
------------------------+-------------+--------------+------------------------
ALL SLOTS 7580 7516|6302 0 513| 765 701 1067| 83 84 10 9 8 24
P&R 2P&R P&2R
F-MEASURES 83.49 83.71 83.28
Go to Top of Page
------------------------------------------------------------------------------
POS ACT| COR PAR INC | MIS SPU NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES | | |
entity | | |
artifact 201 143| 132 0 9| 60 2 8| 66 92 30 1 6 35
organizatio 830 619| 520 0 90| 220 9 47| 63 84 27 1 15 38
person 467 389| 378 0 7| 82 4 2| 81 97 18 1 2 20
location | | |
airport 21 1| 0 0 1| 20 0 2| 0 0 95 0 100 100
city 222 175| 145 0 28| 49 2 6| 65 83 22 1 16 35
country 261 204| 179 0 24| 58 1 6| 69 88 22 0 12 32
province 54 44| 35 0 5| 14 4 17| 65 80 26 9 13 40
region 88 43| 37 0 2| 49 4 5| 42 86 56 9 5 60
unk 33 4| 0 0 4| 29 0 3| 0 0 88 0 100 100
water 12 11| 9 0 1| 2 1 1| 75 82 17 9 10 31
------------------------+-------------+--------------+------------------------
OBJ SCORES | | |
location 691 490| 448 0 30| 213 12 20| 65 91 31 2 6 36
entity 1498 1151|1050 0 86| 362 15 57| 70 91 24 1 8 31
------------------------+-------------+--------------+------------------------
SLOT SCORES | | |
location | | |
locale 695 490| 407 0 71| 217 12 26| 59 83 31 2 15 42
locale_type 691 482| 405 0 65| 221 12 40| 59 84 32 2 14 42
country 689 82| 80 0 1| 608 1 28| 12 98 88 1 1 88
obj_status 0 0| 0 0 0| 0 0 23| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 52| 0 0 0 0 0 0
entity | | |
ent_name 1734 1151| 614 0 427| 693 110 55| 35 53 40 10 41 67
ent_type 1498 1151|1030 0 106| 362 15 57| 69 89 24 1 9 32
ent_descrip 660 18| 8 0 10| 642 0 605| 1 44 97 0 56 99
ent_categor 1498 304| 221 0 80|1197 3 87| 15 73 80 1 27 85
obj_status 0 0| 0 0 0| 0 0 100| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 109| 0 0 0 0 0 0
------------------------+-------------+--------------+------------------------
ALL SLOTS 7465 3678|2765 0 760|3940 153 1182| 37 75 53 4 22 64
P&R 2P&R P&2R
F-MEASURES 49.63 62.34 41.22
Go to Top of Page
------------------------------------------------------------------------------
POS ACT| COR PAR INC | MIS SPU NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES | | |
entity | | |
artifact 197 241| 165 0 17| 15 59 12| 84 68 8 24 9 36
organizatio 866 910| 800 0 33| 33 77 11| 92 88 4 8 4 15
person 469 534| 457 0 7| 5 70 0| 97 86 1 13 2 15
location | | |
airport 21 18| 1 0 17| 3 0 2| 5 6 14 0 94 95
city 226 226| 197 0 9| 20 20 2| 87 87 9 9 4 20
country 260 239| 221 0 10| 29 8 7| 85 92 11 3 4 18
province 52 53| 42 0 6| 4 5 19| 81 79 8 9 13 26
region 89 40| 29 0 11| 49 0 4| 33 73 55 0 28 67
unk 33 14| 4 0 10| 19 0 3| 12 29 58 0 71 88
water 12 10| 10 0 0| 2 0 1| 83 100 17 0 0 17
------------------------+-------------+--------------+------------------------
OBJ SCORES | | |
location 693 626| 554 0 32| 107 40 18| 80 88 15 6 5 24
entity 1532 1685|1432 0 47| 53 206 23| 93 85 3 12 3 18
------------------------+-------------+--------------+------------------------
SLOT SCORES | | |
location | | |
locale 697 626| 511 0 75| 111 40 24| 73 82 16 6 13 31
locale_type 693 600| 504 0 63| 126 33 38| 73 84 18 6 11 31
country 691 624| 493 0 90| 108 41 26| 71 79 16 7 15 33
obj_status 0 0| 0 0 0| 0 0 23| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 52| 0 0 0 0 0 0
entity | | |
ent_name 1761 1731|1305 0 159| 297 267 28| 74 75 17 15 11 36
ent_type 1532 1685|1422 0 57| 53 206 23| 93 84 3 12 4 18
ent_descrip 680 819| 338 0 175| 167 306 585| 50 41 25 37 34 66
ent_categor 1532 1685|1340 0 139| 53 206 53| 87 80 3 12 9 23
obj_status 0 0| 0 0 0| 0 0 100| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 109| 0 0 0 0 0 0
------------------------+-------------+--------------+------------------------
ALL SLOTS 7586 7771|5913 0 758| 915 1100 1061| 78 76 12 14 11 32
P&R 2P&R P&2R
F-MEASURES 77.01 76.45 77.57
Go to Top of Page
------------------------------------------------------------------------------
POS ACT| COR PAR INC | MIS SPU NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES | | |
entity | | |
artifact 207 264| 188 0 3| 16 73 2| 91 71 8 28 2 33
organizatio 854 781| 726 0 47| 81 8 23| 85 93 9 1 6 16
person 465 402| 373 0 26| 66 3 4| 80 93 14 1 7 20
location | | |
airport 21 18| 18 0 0| 3 0 2| 86 100 14 0 0 14
city 226 194| 173 0 19| 34 2 2| 77 89 15 1 10 24
country 261 222| 198 0 22| 41 2 6| 76 89 16 1 10 25
province 51 43| 33 0 8| 10 2 20| 65 77 20 5 20 38
region 87 56| 51 0 5| 31 0 6| 59 91 36 0 9 41
unk 33 15| 13 0 1| 19 1 3| 39 87 58 7 7 62
water 12 9| 6 0 3| 3 0 1| 50 67 25 0 33 50
------------------------+-------------+--------------+------------------------
OBJ SCORES | | |
location 691 557| 536 0 14| 141 7 20| 78 96 20 1 3 23
entity 1526 1447|1300 0 63| 163 84 29| 85 90 11 6 5 19
------------------------+-------------+--------------+------------------------
SLOT SCORES | | |
location | | |
locale 695 564| 455 0 99| 141 10 26| 65 81 20 2 18 35
locale_type 691 557| 492 0 58| 141 7 40| 71 88 20 1 11 30
country 689 540| 479 0 55| 155 6 28| 70 89 22 1 10 31
obj_status 0 0| 0 0 0| 0 0 23| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 52| 0 0 0 0 0 0
entity | | |
ent_name 1754 1552|1265 0 151| 338 136 35| 72 82 19 9 11 33
ent_type 1526 1447|1287 0 76| 163 84 29| 84 89 11 6 6 20
ent_descrip 678 332| 136 0 98| 444 98 587| 20 41 65 30 42 82
ent_categor 1526 1447|1240 0 123| 163 84 59| 81 86 11 6 9 23
obj_status 0 0| 0 0 0| 0 0 100| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 109| 0 0 0 0 0 0
------------------------+-------------+--------------+------------------------
ALL SLOTS 7559 6439|5354 0 660|1545 425 1088| 71 83 20 7 11 33
P&R 2P&R P&2R
F-MEASURES 76.50 80.35 72.99
Go to Top of Page
------------------------------------------------------------------------------
POS ACT| COR PAR INC | MIS SPU NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES | | |
entity | | |
artifact 182 6| 5 0 1| 176 0 27| 3 83 97 0 17 97
organizatio 822 387| 379 0 8| 435 0 55| 46 98 53 0 2 54
person 465 293| 291 0 2| 172 0 4| 63 99 37 0 1 37
location | | |
airport 21 5| 0 0 5| 16 0 2| 0 0 76 0 100 100
city 227 120| 3 0 117| 107 0 1| 1 3 47 0 98 99
country 259 143| 0 0 143| 116 0 8| 0 0 45 0 100 100
province 51 29| 1 0 28| 22 0 20| 2 3 43 0 97 98
region 87 30| 0 0 30| 57 0 6| 0 0 66 0 100 100
unk 35 27| 25 0 0| 10 2 1| 71 93 29 7 0 32
water 12 5| 4 0 1| 7 0 1| 33 80 58 0 20 67
------------------------+-------------+--------------+------------------------
OBJ SCORES | | |
location 692 359| 349 0 8| 335 2 19| 50 97 48 1 2 50
entity 1469 686| 676 0 10| 783 0 86| 46 99 53 0 1 54
------------------------+-------------+--------------+------------------------
SLOT SCORES | | |
location | | |
locale 696 360| 288 0 69| 339 3 25| 41 80 49 1 19 59
locale_type 692 359| 33 0 324| 335 2 39| 5 9 48 1 91 95
country 691 359| 177 0 179| 335 3 26| 26 49 48 1 50 74
obj_status 0 0| 0 0 0| 0 0 23| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 52| 0 0 0 0 0 0
entity | | |
ent_name 1717 795| 632 0 146| 939 17 72| 37 79 55 2 19 64
ent_type 1469 686| 675 0 11| 783 0 86| 46 98 53 0 2 54
ent_descrip 641 1| 0 0 1| 640 0 624| 0 0 100 0 100 100
ent_categor 1469 685| 496 0 189| 784 0 116| 34 72 53 0 28 66
obj_status 0 0| 0 0 0| 0 0 100| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 109| 0 0 0 0 0 0
------------------------+-------------+--------------+------------------------
ALL SLOTS 7375 3245|2301 0 919|4155 25 1272| 31 71 56 1 29 69
P&R 2P&R P&2R
F-MEASURES 43.33 56.52 35.14
Go to Top of Page
------------------------------------------------------------------------------
POS ACT| COR PAR INC | MIS SPU NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES | | |
entity | | |
artifact 200 201| 169 0 10| 21 22 9| 85 84 11 11 6 24
organizatio 864 843| 799 0 20| 45 24 13| 92 95 5 3 2 10
person 468 465| 449 0 6| 13 10 1| 96 97 3 2 1 6
location | | |
airport 22 27| 20 0 2| 0 5 1| 91 74 0 19 9 26
city 224 230| 203 0 14| 7 13 4| 91 88 3 6 6 14
country 263 273| 257 0 3| 3 13 4| 98 94 1 5 1 7
province 52 59| 47 0 5| 0 7 19| 90 80 0 12 10 20
region 89 90| 77 0 7| 5 6 4| 87 86 6 7 8 19
unk 34 27| 19 0 6| 9 2 2| 56 70 26 7 24 47
water 12 12| 10 0 1| 1 1 1| 83 83 8 8 9 23
------------------------+-------------+--------------+------------------------
OBJ SCORES | | |
location 696 718| 656 0 15| 25 47 15| 94 91 4 7 2 12
entity 1532 1509|1421 0 32| 79 56 23| 93 94 5 4 2 11
------------------------+-------------+--------------+------------------------
SLOT SCORES | | |
location | | |
locale 700 723| 644 0 31| 25 48 21| 92 89 4 7 5 14
locale_type 696 718| 633 0 38| 25 47 35| 91 88 4 7 6 15
country 695 718| 586 0 84| 25 48 22| 84 82 4 7 13 21
obj_status 0 0| 0 0 0| 0 0 23| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 52| 0 0 0 0 0 0
entity | | |
ent_name 1761 1787|1506 0 116| 139 165 28| 86 84 8 9 7 22
ent_type 1532 1509|1417 0 36| 79 56 23| 92 94 5 4 2 11
ent_descrip 679 533| 392 0 86| 201 55 586| 58 74 30 10 18 47
ent_categor 1532 1509|1369 0 84| 79 56 53| 89 91 5 4 6 14
obj_status 0 0| 0 0 0| 0 0 100| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 109| 0 0 0 0 0 0
------------------------+-------------+--------------+------------------------
ALL SLOTS 7595 7497|6547 0 475| 573 475 1052| 86 87 8 6 7 19
P&R 2P&R P&2R
F-MEASURES 86.76 87.10 86.42
Go to Top of Page
------------------------------------------------------------------------------
POS ACT| COR PAR INC | MIS SPU NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES | | |
entity | | |
artifact 194 137| 93 0 31| 70 13 15| 48 68 36 9 25 55
organizatio 857 817| 725 0 56| 76 36 20| 85 89 9 4 7 19
person 466 449| 416 0 12| 38 21 3| 89 93 8 5 3 15
location | | |
airport 21 8| 1 0 7| 13 0 2| 5 13 62 0 88 95
city 227 209| 137 0 63| 27 9 1| 60 66 12 4 32 42
country 260 231| 200 0 26| 34 5 7| 77 87 13 2 12 25
province 53 55| 39 0 5| 9 11 18| 74 71 17 20 11 39
region 88 47| 38 0 6| 44 3 5| 43 81 50 6 14 58
unk 33 7| 0 0 7| 26 0 3| 0 0 79 0 100 100
water 12 10| 2 0 7| 3 1 1| 17 20 25 10 78 85
------------------------+-------------+--------------+------------------------
OBJ SCORES | | |
location 694 567| 509 0 29| 156 29 17| 73 90 22 5 5 30
entity 1517 1403|1249 0 84| 184 70 38| 82 89 12 5 6 21
------------------------+-------------+--------------+------------------------
SLOT SCORES | | |
location | | |
locale 698 567| 429 0 109| 160 29 23| 61 76 23 5 20 41
locale_type 694 567| 417 0 121| 156 29 37| 60 74 22 5 22 42
country 693 567| 390 0 147| 156 30 24| 56 69 23 5 27 46
obj_status 0 0| 0 0 0| 0 0 23| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 52| 0 0 0 0 0 0
entity | | |
ent_name 1747 1474| 996 0 319| 432 159 42| 57 68 25 11 24 48
ent_type 1517 1403|1234 0 99| 184 70 38| 81 88 12 5 7 22
ent_descrip 668 549| 155 0 163| 350 231 597| 23 28 52 42 51 83
ent_categor 1517 1403|1073 0 260| 184 70 68| 71 76 12 5 20 32
obj_status 0 0| 0 0 0| 0 0 100| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 109| 0 0 0 0 0 0
------------------------+-------------+--------------+------------------------
ALL SLOTS 7534 6530|4694 0 1218|1622 618 1113| 62 72 22 9 21 42
P&R 2P&R P&2R
F-MEASURES 66.75 69.74 64.01
Go to Top of Page
------------------------------------------------------------------------------
POS ACT| COR PAR INC | MIS SPU NON| REC PRE UND OVG SUB ERR
------------------------+-------------+--------------+------------------------
SUBTASK SCORES | | |
entity | | |
artifact 194 158| 127 0 9| 58 22 15| 65 80 30 14 7 41
organizatio 850 796| 758 0 21| 71 17 27| 89 95 8 2 3 13
person 467 429| 413 0 7| 47 9 2| 88 96 10 2 2 13
location | | |
airport 21 23| 16 0 3| 2 4 2| 76 70 10 17 16 36
city 225 231| 190 0 27| 8 14 3| 84 82 4 6 12 21
country 267 330| 260 0 4| 3 66 0| 97 79 1 20 2 22
province 54 56| 43 0 9| 2 4 17| 80 77 4 7 17 26
region 88 68| 31 0 36| 21 1 5| 35 46 24 1 54 65
unk 33 22| 14 0 4| 15 4 3| 42 64 45 18 22 62
water 12 12| 5 0 7| 0 0 1| 42 42 0 0 58 58
------------------------+-------------+--------------+------------------------
OBJ SCORES | | |
location 700 742| 604 0 45| 51 93 11| 86 81 7 13 7 24
entity 1511 1383|1304 0 31| 176 48 44| 86 94 12 3 2 16
------------------------+-------------+--------------+------------------------
SLOT SCORES | | |
location | | |
locale 704 742| 553 0 96| 55 93 17| 79 75 8 13 15 31
locale_type 700 742| 559 0 90| 51 93 31| 80 75 7 13 14 30
country 699 742| 520 0 128| 51 94 18| 74 70 7 13 20 34
obj_status 0 0| 0 0 0| 0 0 23| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 52| 0 0 0 0 0 0
entity | | |
ent_name 1745 1691|1340 0 176| 229 175 44| 77 79 13 10 12 30
ent_type 1511 1383|1298 0 37| 176 48 44| 86 94 12 3 3 17
ent_descrip 666 417| 141 0 178| 347 98 599| 21 34 52 24 56 82
ent_categor 1511 1383|1236 0 99| 176 48 74| 82 89 12 3 7 21
obj_status 0 0| 0 0 0| 0 0 100| 0 0 0 0 0 0
comment 0 0| 0 0 0| 0 0 109| 0 0 0 0 0 0
------------------------+-------------+--------------+------------------------
ALL SLOTS 7536 7100|5647 0 804|1085 649 1111| 75 80 14 9 12 31
P&R 2P&R P&2R
F-MEASURES 77.17 78.57 75.81
Go to Top of Page