20 features for evaluation in 2009

The following 20 features will be annotated in the feature development
data for TRECVID 2009. The 10 marked with a "*" are a subset of those
tested in 2008; their definitions have not changed, nor their numbers.


G e n e r a l   r u l e s:

The following rules are used by the NIST assessors in judging TRECVID
feature and search system results and so should also be used by
TRECVID training data annotators and system builders.

a) Features are meant to describe the presence or absence of VIDEO of
some target person, place, thing, activity, etc., NOT INFORMATION
about that target. So, for example, video just of someone talking
about X is not by itself sufficient to assert that the feature X is
true with respect to the video.

b) When a feature definition says a shot must contain x, that is short
for "contain x to a degree sufficient for x to be recognizable as x to
a human". This means among other things that unless explicitly stated,
partial visibility or audibility may suffice.

c) The fact that a segment contains video of physical objects
REPRESENTING the feature target, such as photos, paintings, models, or
toy versions of the feature target, should NOT be grounds for judging
the segment relevant/true. Containing video of the target within the
video segment may be grounds for doing so.


F e a t u r e s   f o r   e v a l u a t i o n 


Please use the numbers listed below when submitting results for these
features

001 * Classroom: a school- or university-style classroom scene. One or
more students must be visible. A teacher and teaching aids
(e.g. blackboard) may or may not be visible.


002 Chair - a seat with four legs and a back for one person


003 Infant - a very small child, crawling, lying down, or being held,
with no evidence it can walk


004 Traffic intersection - crossing of two roads or paths with some
human and/or vehicular traffic visible


005 Doorway - an opening you can walk through into a room or building


006 * Airplane_flying: external view of a heavier than air, fixed-wing
aircraft in flight - gliders included. NOT balloons, helicopters,
missiles, and rockets


007 Person-playing-a-musical-instrument - both player and instrument visible


008 * Bus: external view of a large motor vehicle on tires used to carry
many passengers on streets, usually along a fixed route. NOT vans and
SUVs

009  Person-playing-soccer - need not be teams or on a dedicated soccer field


010 * Cityscape: a view of a large urban setting, showing skylines and
building tops. NOT just street-level views of urban life


011 Person-riding-a-bicycle - a bicycle has two wheels; while riding,
both feet are off the ground and the bicycle wheels are in motion 


012 * Telephone: any kinds of telephone, but more than just a headset
must be visible.


013 Person-eating - putting food or drink in his/her mouth


014 * Demonstration_Or_Protest: an outdoor, public exhibition of
disapproval carried out by multiple people, who may or may not be
walking, holding banners or signs


015 * Hand: a close-up view of one or more human hands, where the hand
is the primary focus of the shot.


016 People-dancing - one or more, not necessarily with each other


017 * Nighttime: a shot that takes place outdoors at night. NOT sporting
events under lights


018 * Boat_Ship: exterior view of a boat or ship in the water,
e.g. canoe, rowboat, kayak, hydrofoil, hovercraft, aircraft carrier,
submarine, etc.


019  Female-human-face-closeup - closeup of a female human's face (face
must clearly fill more than 1/2 of height or width of a frame but can
be from any angle and need not be completely visible) 


020 * Singing: one or more people singing - singer(s) visible and
audible, solo or accompanied, amateur or professional