From over at nist.gov Tue May 6 10:59:14 2014 From: over at nist.gov (Paul Over) Date: Tue, 06 May 2014 10:59:14 -0400 Subject: [tv14.list] Change to SIN and INS submission format (DTDs) Message-ID: <5368F8C2.1040905@nist.gov> Hi, For participants in the SIN and INS tasks ... Please note that we have made a small but important change to the run submission format for both the semantic indexing and the instance search tasks: "sysId" has been replaced with "pid" - participant ID from the leftmost column of the tv14.who.what table in the active participant's area of the TRECVID website. All the runs from a given team will have the same "pid". This change will make it more important than earlier that you only assign each possible "priority" to a single run. Please have a look at the DTDs and small examples linked from the guidelines. Click on the link, then right click and select "view page source" to see the full file. SIN: http://www-nlpir.nist.gov/projects/tv2014/dtds/videoFeatureExtractionRunResult.dtd http://www-nlpir.nist.gov/projects/tv2014/dtds/videoFeatureExtractionResults.xml INS: http://www-nlpir.nist.gov/projects/tv2014/dtds/videoSearchRunResult.dtd http://www-nlpir.nist.gov/projects/tv2014/dtds/INS.videoSearchResults.xml Thanks, Paul -- Paul Over ---------------------------------------------- Retrieval Group Information Access Division Information Technology Laboratory National Institute of Standards and Technology Gaithersburg, MD 20899-8940 USA Bldg. 225 Rm. A211 (Mailstop 8940) Voice: 301 975-6784 Fax: 301 975-5287 From gawad at nist.gov Mon May 12 10:45:28 2014 From: gawad at nist.gov (George Awad) Date: Mon, 12 May 2014 10:45:28 -0400 Subject: [tv14.list] Reminders and Announcements for SIN participants In-Reply-To: <5370DC56.20507@nist.gov> References: <5370DC56.20507@nist.gov> Message-ID: <5370DE88.4010705@nist.gov> Hi, A couple of *_IMPORTANT_* reminders for SIN task participants: 1- Please note the NIST manual assessment rules ( http://www-nlpir.nist.gov/projects/tv2014/assessment.html ) so that you can *_avoid_* submitting shots that will be judged as non-relevant specially submitting videos of still pictures/frames!. 2- Please *_avoid_* submitting duplicate shots within a given concept because those are filtered out and can lower your scores. 3- The SIN run submission page is scheduled to be open for testing/trial runs on 6. Jun, and for official runs on 20. Jun and all runs must be submitted by 27. Jun. During testing, use the "TEST" team ID so you get feedback about any errors but your test submissions are not kept. For final submissions, use your official TRECVID team ID. 4- Please note the changed guidelines for training types (esp A) : http://www-nlpir.nist.gov/projects/tv2014/restrictions.html. This change along with the change of "targetYear" to "targetData" for progress runs is reflected in the submission format and the controlling DTD. Follow the link, then right click to "view page source": http://www-nlpir.nist.gov/projects/tv2014/dtds/videoFeatureExtractionRunResult.dtd 5- The url for the submission website is http://ir.nist.gov/tv-submit/tv14.sin.submissions.html and is also included in the Guidelines (under Submissions). It will require you to use your active participant's password. Official submissions are FINAL; no replacements allowed. Please abide by the limits in the guidelines on number of runs. Thanks George -------------- next part -------------- An HTML attachment was scrubbed... URL: https://email.nist.gov/mailman/private/tv14.list/attachments/20140512/875e5b94/attachment.html -------------- next part -------------- A non-text attachment was scrubbed... Name: gawad.vcf Type: text/x-vcard Size: 275 bytes Desc: not available Url : https://email.nist.gov/mailman/private/tv14.list/attachments/20140512/875e5b94/attachment.vcf From gawad at nist.gov Fri May 30 10:00:11 2014 From: gawad at nist.gov (George Awad) Date: Fri, 30 May 2014 10:00:11 -0400 Subject: [tv14.list] SIN Submission webpage open Message-ID: <53888EEB.3050500@nist.gov> Hi, The Semantic Indexing task Submission webpage is now open for _*trial*_ submissions only. You will have to use your _password_ to access the submission page here: http://ir.nist.gov/tv-submit/tv14.sin.submissions.html Please use the team ID "FOR TESTING ONLY" (first entry in the drop down menu). The *official* submissions will start on the *_16 June_* till *_27 june_*. All trial submissions will then be discarded. *_Please_* take the time to submit trial runs to correct any errors the submission checker reports before you submit the official runs. Notes: 1- During official submissions, remember to use your correct *TEAM* name. 2- The submission checker accepts only *_o_**_ne run per compressed file. _*3- The submission checker accepts only *_o_**_ne optional localization file per compressed file. _*Thanks and Good Luck! George -------------- next part -------------- An HTML attachment was scrubbed... URL: https://email.nist.gov/mailman/private/tv14.list/attachments/20140530/36b0ae14/attachment.html -------------- next part -------------- A non-text attachment was scrubbed... Name: gawad.vcf Type: text/x-vcard Size: 264 bytes Desc: not available Url : https://email.nist.gov/mailman/private/tv14.list/attachments/20140530/36b0ae14/attachment.vcf