Video Data

A number of datasets are available for use in TRECVID 2020 and are described below.

Once you know which tasks you will be participating in, you can determine which data sets you need.
Then for each needed dataset, see below for information on how you get permission to use the data and how it will be distributed.

Low Altitude Disaster Imagery (LADI)

The LADI Development dataset is hosted as part of the AWS Public Dataset program and will be available to participants of the DSDI task. It consists of over 20,000+ annoated images, each at least 4 MB in size. For more information about the LADI datset pelase refer to the github organization

TRECVid 2020 BBC EastEnders Challenge

Approximately 244 video files (totally 300 GB, 464 h) with associated metadata, each containing a week's worth of BBC EastEnders programs in MPEG-4/H.264 format.

Data use agreements and Distribution: The datasets for this TRECVid challenge are from a BBC programme called ‘EastEnders’. The BBC EastEnders datasets (including videos and metadata) are supplied for non-commercial, academic research by Dublin City University. Before getting access, your organisation will need to sign a ‘BBC R&D Permission to Use for Participants’ form which is a licence agreement with the BBC. To download a copy of the BBC form please go to https://www.bbc.co.uk/rd/projects/bbc-trecvid-eastenders-academic-challenge-dataset. Dublin City University will then receive a copy of the signed approved by the BBC, participants will be supplied with passwords, and the BBC datasets can then be downloaded from Dublin City University website url : http://ftp.heanet.ie/trecvid-bbc/

Master shot reference: Will be available to active participants by download from the TRECVID 2020 active participant's area.

Automatic speech recognition (for English): Will be available to active participants by download from Dublin City University.

Vimeo Creative Commons Collection 1 (V3C1)

The V3C1 dataset (drawn from a larger V3C video dataset) is composed of 7475 Vimeo videos (1.3 TB, 1000 h) with Creative Commons licenses and mean duration of 8 min. All videos will have some metadata available e.g., title, keywords, and description in json files. The dataset has been segmented into 1,082,659 short video segments according to the provided master shot boundary files. In addition, Keyframes and thumbnails per video segment have been extracted and available.

The master shot reference for the V3C1 dataset can be downloaded from here with a readme file
Speech transcripts for the V3C1 dataset are also available online from this github repository generated using the public Google Cloud Speech-to-Text API.

Data use agreements and Distribution: See Data use agreements for download instructions for active participants from NIST/mirror servers and from ITEC university.

Raw V3C1 dataset including metadata will be available for download from servers of ITEC - Institute of Information Technology. While segmented shots from raw videos will be available to download from NIST. Information about downloading the V3C1 from ITEC university can be obtained from the active participants tv20 data servers page

Vimeo Creative Commons Collection 2 (V3C2)

In 2020, NIST will be using a small subset of videos from V3C2 for the VTT task testing dataset. Please consult the general schedule for data release and submission of results dates.

Data use agreements and Distribution: See Data use agreements for download instructions for active participants from NIST servers.

IACC.3

The IACC.3 dataset is approximately 4600 Internet Archive videos (144 GB, 600 h) with Creative Commons licenses in MPEG-4/H.264 format with duration ranging from 6.5 min to 9.5 min and a mean duration of almost 7.8 min. Most videos will have some metadata provided by the donor available e.g., title, keywords, and description.

Data use agreements and Distribution: Download for active participants from NIST/mirror servers. See Data use agreements

Master shot reference: Available by download from the TRECVID Past Data page

Automatic speech recognition (for English): Available by download from the TRECVID Past Data page

IACC.2.A-C

Three datasets (A,B,C) - totaling approximately 7300 Internet Archive videos (144 GB, 600 h) with Creative Commons licenses in MPEG-4/H.264 format with duration ranging from 10 s to 6.4 min and a mean duration of almost 5 min. Most videos will have some metadata provided by the donor available e.g., title, keywords, and description.

NOTE: Be sure to reload the relevant collection.xml files (A, B, C) in the master shot reference and remove files with a "use" attribute set to "dropped" - these are no longer available under a Creative Commons license and are not part of the test collection.

Data use agreements and Distribution: Download for active participants from NIST/mirror servers. See Data use agreements

Master shot reference: Available by download from the TRECVID Past Data page

Automatic speech recognition (for English): Available by download from the TRECVID Past Data page

IACC.1.A-C

Three datasets (A,B,C) - totaling approximately 8000 Internet Archive videos (160 GB, 600 h) with Creative Commons licenses in MPEG-4/H.264 format with duration between 10s and 3.5 min. Most videos will have some metadata provided by the donor available e.g., title, keywords, and description

Data use agreements and Distribution: Available by download from the Internet Archive. See TRECVID Past Data page. Or download from the copy on the Dublin City University server, but use the collection.xml files (see TRECVID past data page) for instructions on how to check the current availability of each file.

Master shot reference: Available by download from the TRECVID Past Data page

Automatic speech recognition (for English): Available by download from the TRECVID Past Data page

IACC.1.tv10.training

Approximately 3200 Internet Archive videos (50 GB, 200 h) with Creative Commons licenses in MPEG-4/H.264 format with durations between 3.6 and 4.1 min Most videos will have some metadata provided by the donor available e.g., title, keywords, and description

Data use agreements and Distribution: Available by download from the Internet Archive. See TRECVID Past Data page. Or download from the copy (see tv2010 directory) on the Dublin City University server, but use the collection.xml files (see TRECVID past data page) for instructions on how to check the current availability of each file.

Master shot reference: Available by download from the TRECVID Past Data page

Common feature annotation: Available by download from the TRECVID Past Data page

Automatic speech recognition (for English): Available by download from the TRECVID Past Data page

VIRAT Video (V1 and V2, Kitware's M1) data

Development and evaluation data resources will be provided by Kitware. For the first phase of the evaluation, a previously unreleased portion of the VIRAT dataset will be used as the evaluation set. New Kitware M1 dataset will be available for participants of ActEV task..

Gatwick and i-LIDS MCT airport surveillance video

The data consist of about 150 h of airport surveillance video data (courtesy of the UK Home Office). The Linguistic Data Consortium has provided event annotations for the entire corpus. The corpus was divided into development and evaluation subsets. Annotations for 2008 development and test sets are available.

Data use agreements and Distribution:

Gatwick development data (2008 DevSet and 2008 EvalSet) by download from password-protected servers at NIST and mirror sites. See Data use agreements
2009 i-LIDS test data from United Kingdom's Centre for Applied Science and Technology (CAST) can be downloaded from NIST but only after CAST has received the required information and issued a userid/password. See here for details.

Development data annotations: available by download.

Data use agreements handled by NIST

In order to be eligible to receive the data, you must have applied for participation in TRECVID. Your application will be acknowledged by NIST with a team ID, and active participant's password, and information about how to obtain the data.

If you will be using i-LIDS (2009), NIST will NOT be handling the data use agreements. See the "Data Use Agreements and Distribution" section for i-LIDS.

If you will be using IACC.1 video, the data use agreements are available from the "Past data" webpage. You will be downloading the data from the Dublin City University server (see above) or the Internet Archive. See the "Data Use Agreements and Distribution" section for IACC.1

If you will be needing to get a copy of Gatwick(2008), IACC.2, IACC.3, or V3C1 data you will need to complete the relevant permission forms (from the active participant's area) and email the scanned page images for each form as one Adobe Acrobat pdf of the document to Angela Ellis.

If you need to request the TRECVid 2020 BBC Eastenders Challenge data please visit https://www.bbc.co.uk/rd/projects/bbc-trecvid-eastenders-academic-challenge-dataset to download, sign and submit the form to Dublin City University.

If you need access to the V3C2 data for VTT, you will need to complete the relevant permission form (from the active participant's area) and email the scanned page as Adobe Acrobat pdf to Asad Butt.
Note that if you signed the permission form last year for IACC.2, IACC.3, Gatwick, or V3C1 and do not need to replace your original copy then you do not need to submit another permission form this year. However, BBC Eastenders data requires all participants to submit a new permission form.
In your email include the following:
```
As Subject: "TRECVID data request"
In the body: your name
             your short team ID (given when you applied to participate)
             the kinds of data you will be using - one or more of the following:
         Gatwick (2008), IACC.2, IACC.3, V3C1, V3C2 and/or BBC EastEnders 
```
You will receive instructions on how to download the data.

Please ask only for the test data (and optional development data) required for the task(s) you apply to participate in and intend to complete.

Requests are handled in the order they are received. Please allow 5 business days for NIST to respond to your request. To download the Gatwick, IACC, V3C1, or V3C2 data you need to use the access codes sent to you by email and the information about data servers in the the active participant's area.

Requests for the EastEnders data are forwarded within 5 business days to the BBC and from there to DCU, who will contact you with the download information. This process may take up to 3 weeks.