Dear all,

As a result of few requests and issues related with the ActEV evaluation scoring code and the scoring pipeline, we are extending the TRECVID ActEV 2019 evaluation deadline till October 1st at 1:00 pm EST, but we will keep the TRECVID ActEV Evaluation Leaderboard running till November 15th at 11:00 am.

 

We will use the team results based on the ranking on Tuesday, October 1st at 1:00 pm EST as the evaluation results for the TRECVID 2019 workshop. 

 

All the previous submissions have been re-scored with the latest master branch of the ActEV_Scorer and we corrected the problem with Martin’s new submissions not being included (Thanks Martin for reporting it).  The new scoring code version will allow us to give better system performance diagnostics.  We added the "activity average DEC curve" to the leaderboard to help with tuning and optimizing the activity detection systems and we enabled a new button “All Submissions” button under the “Submission Management” page to see all submissions related to a system.  We will have additional diagnostics reports that will get rolled out in the near future.

 

Please note the following important dates:

 

- Leaderboard snapshot taken for TRECVID: October 1, 2019, 1:00 pm EST

- Workshop speakers’ proposal: Due October 1, 2019 -- Please consider submitting an abstract to give a talk about your approaches this year.

- TRECVID notebook draft paper: Due October 29, 2019 -- REQUIRED by any team submitted one or more runs in any task

- TRECVID workshop Registration: Due November 6, 2019 (Registration site is already open)

- TRECVID workshop at NIST: Nov. 12 - 13, 2019

 

 

Best regards,

-Afzal for the NIST ActEV team  <[email protected]>