*** Important Announcement ***
Unfortunately, the organizers had originally planned to use testing dataset (The BBC Land Girls series). 
Due to unforeseen circumstances with the hosting entity, the agreement to host the data was not successful and
The BBC couldn't allow the distribution of the data this year. Hence, we are planning to release 4 creative common full movies
As the testing dataset for 2021 grand challenge. We apologize for the inconvenience and we do still hope to re-use the Land Girls
Again next year in 2022 challenge as the data has already been annotated and ready for deployment.
******************************

The testing dataset can be accessed through the following path:
URL : https://www-nlpir.nist.gov/projects/trecvid/dvu/testing/

The testing dataset directory structure is as follows:

<movies> : This folder contains the 4 testing movies in mp4 files

<scene.segmentation.reference> : This folder contains 1 CSV file for each movie scene segmentation boundaries as follows:
                                 The start and end times for each scene per line, separated by a comma:
				 <HH:MM:SS>,<HH:MM:SS>

<movie.shots> : This folder contains the segmented movie scenes as webm files (based on the CSV file scene segments). 
                Each scene file is named as <movie_name>-<scene_number>.webm

<vocab.dvu.json> : This file contains the used vocabulary (ontology) in the training scene annotations (json graph files) and also for testing queries. 
                          Specifically, it has a set of
                           - Emotional states [used by annotators to describe unneutral actors' emotions when observed)
			   - Interactions [used by annotators to describe the interaction type that may have happened between at least any two actors in a scene]
			   - Relationships [used by annotators to establish a relationship between any two actors when it became apparent to them]
			   - Sentiments [used by annotators to assign at least one sentiment to each scene]
			   - Locations [used by annotators to describe the location type where the scene happened]

NOTES:
1- The movie scenes will form the basis for scene-level queries.
2- The official testing queries will include image snapshot of key characters and locations where queries may reference.

NOTE:
These movies are to the best of our knowledge Creative Commons licensed. 
Links to license details on free YouTube hosting:

https://www.youtube.com/watch?v=TH-ep4nCNWw - "Casino Jack" aka "Bagman"

https://www.youtube.com/watch?v=j5JQ1iaq6rE - "Road to Bali"

https://www.youtube.com/watch?v=KunQC6a6fPU - "The Illusionist"

https://www.youtube.com/watch?v=D3LBZLA0V3k - "Manos: The Hands of Fate"