Detecting human behaviors efficiently in vast amounts surveillance video is fundamental technology for a variety of higher-level applications of critical importance to public safety and security. The use case addressed by this task is the retrospective exploration of surveillance video archives optionally using a system designed to support the optimal division of labor between a human user and the software - an interactive system.
Retrospective Event Detection: The task is to detect observations of events based on the event definition. Systems may process the full corpus using multiple passes prior to outputting a list of putative events observations. The primary condition for this task will be single-camera input (i.e., the camera views are processed independently). Multiple-camera input may optionally be run as an additional contrastive condition.
The test data will be the same i-LIDS data that was made available to participants for previous SED evaluations. The selected data subset for the evaluation will be extended from the EVAL15 task.
Submissions will follow the same format and procedure as in the SED 2016 task. The number of submissions allowed will be defined in the Evaluation Plan.
The updated SED 2017 webpage with a link to the detailed evaluation plan is now available and running with additional details. .
It is assumed the user(s) are system experts and no attempt will be made to separate the contribution of the user and the system. The results for each system+user will be evaluated by NIST as to effectiveness - using standard search measures (e.g., probability of missed detection/false alarm, precision, recall, average precision)- self-reported speed, and user satisfaction (for interactive runs).