TRECVID Contact Citations Task Proposals ActEV Sequestered Data Leaderboard Attending TRECVID workshop

TREC Video Retrieval Evaluation: TRECVID

The TREC conference series is sponsored by the National Institute of Standards and Technology (NIST) with additional support from other U.S. government agencies. The goal of the conference series is to encourage research in information retrieval by providing a large test collection, uniform scoring procedures, and a forum for organizations interested in comparing their results. In 2001 and 2002 the TREC series sponsored a video "track" devoted to research in automatic segmentation, indexing, and content-based retrieval of digital video. Beginning in 2003, this track became an independent evaluation (TRECVID) with a workshop taking place just before TREC.

TRECVID 2019

TRECVID 2019 is now completed. If you would like to join TRECVID 2020 please send a request by email

1st International Workshop on Video Retrieval Methods and Their Limits (ViRaL)

In conjunction with ICCV2019, TRECVID teams and external researchers are invited to submit papers with the focus on but not limited to:

  • Comparative analysis of performance of search systems on different datasets
  • Fusion of computer vision, text/language processing and audio analysis for video search
  • Evaluation protocols and metrics for assessing the impact of specific components of retrieval systems
  • Failure analysis of vision-based components in video search and retrieval systems
  • Failure analysis of query types, dataset characteristics, metrics, and system architectures
  • Integrating user interaction in search systems and their impact on performance
  • Approaches for measuring and predicting hardness/complexity of queries in a system-independent way

TRECVID Statement on Product Testing and Advertising:

The annual "TREC Video Retrieval Evaluation" (TRECVID) is an event in which organizations with an interest in information retrieval research take part in a coordinated series of experiments using the same experimental data. The goal of the conference series is to create the infrastructure necessary for large-scale evaluation of research retrieval systems and thereby foster research into effective techniques for information access.

By design, TRECVID is explicitly not a venue for commercial product tests. A valid, informative vendor test requires a level of control in task definition and system execution that is counter to the scientific research goals of TRECVID. Insofar as TRECVID participants do the same task, the results from different participating teams are comparable, but interpretation of what those results actually represent may vary widely. For example, commercial participants may submit results from research prototype systems rather than their production system, or participants may deliberately degrade one aspect of their system to focus on another aspect.

To preserve the desired, pre-competitive nature of the TRECVID conferences, TRECVID requires all participants to sign and abide by *an agreement concerning the dissemination and publication of TRECVID evaluation results* The guidelines embodied in the agreement are meant to preclude the publication of incomplete or inaccurate information that could damage the reputation of the conference or its participants. In particular, the agreement prohibits any advertising based on TRECVID results and sharply curtails the use of TRECVID results in marketing literature.

NIST and the TRECVID coordinators are strongly committed to the ethos of cooperation the guidelines are designed to engender, but cannot accept responsibility for performance claims made by participants in violation of the agreement. TRECVID reserves the right to prohibit violators from participating in future TRECVID conferences.

Digital Video Retrieval at NIST

Digital Video Retrieval at NIST
News magazine, science news, news reports, documentaries, educational programming, and archival video

Digital Video Retrieval at NIST
TV Episodes

Digital Video Retrieval at NIST
Airport Security Cameras & Activity Detection

Digital Video Retrieval at NIST
Video collections from News, Sound & Vision, Internet Archive,
Social Media, BBC Eastenders