Topics:

Example types of video needs

• a specific person
• one or more instances of a category of people
• a specific thing
• one or more instances of a category of things
• a specific event/activity
• one or more instances of a category of events/activities
• a specific location
• one or more instances of a category of locations
• combinations of the above

Topics may target commercials as well as news content.

Topics:

The topics, formatted multimedia statements of information need, will be developed by NIST who will control their distribution. The topics will express the need for video concerning people, things, events, locations, etc. and combinations of the former. Candidate topics (text only) will be created at NIST by examining a large subset of the test collection videos without reference to the audio, looking for candidate topic targets. Note: Following the VACE III goals, topics asking for video of events will be much more frequent this year - exploring the limits of one-keyframe-per-shot approaches for this kind of topic and encouraging exploration beyond those limits. Accepted topics will be enhanced with non-textual examples from the Web if possible and from the development data if need be. The goal is to create 24 topics.

* Note: The identification of any commercial product or trade name does not imply endorsement or recommendation by the National Institute of Standards and Technology

• Topics describe the information need. They are input to systems and guide to humans assessing relevance of system output
• Topics are multimedia objects - subject to the nature of the need and the questioner's choice of expression
• As realistic in intent and expression as possible
• Template for topic:
• Title
• Brief textual description of the information need (this text may contain references to the examples)
• Examples* of what is wanted:
• reference to video clip
• Optional brief textual clarification of the example's relation to the need
• reference to image
• Optional brief textual clarification of the example's relation to the need
• reference to audio
• Optional brief textual clarification of the example's relation to the need
* If possible, the examples will come from outside the test data. They could be taken from various stable public domain sources. If the example comes from the test collection, the text description will be such that using a quotation from the test collection is plausible, e.g., "I want to find all the OTHER shots dealing with X." A search for a single shot cannot be described with an example from the target shot.