By design, TRECVID is explicitly not a venue for commercial product tests. A valid, informative vendor test requires a level of control in task definition and system execution that is counter to the scientific research goals of TRECVID. Insofar as TRECVID participants do the same task, the results from different participating teams are comparable, but interpretation of what those results actually represent may vary widely. For example, commercial participants may submit results from research prototype systems rather than their production system, or participants may deliberately degrade one aspect of their system to focus on another aspect.
To preserve the desired, pre-competitive nature of the TRECVID conferences, TRECVID requires all participants to sign and abide by *an agreement concerning the dissemination and publication of TRECVID evaluation results* The guidelines embodied in the agreement are meant to preclude the publication of incomplete or inaccurate information that could damage the reputation of the conference or its participants. In particular, the agreement prohibits any advertising based on TRECVID results and sharply curtails the use of TRECVID results in marketing literature.
NIST and the TRECVID coordinators are strongly committed to the ethos of cooperation the guidelines are designed to engender, but cannot accept responsibility for performance claims made by participants in violation of the agreement. TRECVID reserves the right to prohibit violators from participating in future TRECVID conferences.
is an agency of the U.S. Commerce Department
Date created: Wednesday, January 25, 2012
privacy policy / security notice / accessibility statement
disclaimer / FOIA