NIST is currently running the ActEV (Activities in Extended Video) Sequestered Data Leaderboard (https://actev.nist.gov/sdl), which is an ongoing ranking of activity detection systems for activity detection. Anyone can submit their system to NIST in a form compatible with the ActEV Command Line Interface, which will then run the system on sequestered data, score the results and post the score to the leaderboard. The sequestered data is from the MEVA dataset (mevadata.org), which contains hours of videos, including indoor and outdoor scenes, night and day, crowds and individuals, and videos are from both EO (Electro-Optical) and IR (Infrared) sensors. There are times with no activities, but then multiple activities happen simultaneously. The data is multi-camera, in that multiple cameras may be pointed at the same scene at the same time. The results are posted on two separate leaderboards for EO and IR videos.

For more information about the ActEV SDL Evaluation see the website and the evaluation plan at: https://actev.nist.gov/sdl

The results of the evaluation will be presented at the TRECVID Workshop (Nov 12-13, at NIST in Gaithersburg, MD) and at a future workshop.

NIST welcomes suggestions and comments toward improving the ActEV SDL evaluation. We look forward to your participation or any additional correspondence in this regard.

Best wishes,

NIST ActEV team

ActEV team: [email protected]