From over at nist.gov Wed Aug 7 11:36:03 2013 From: over at nist.gov (Paul Over) Date: Wed, 7 Aug 2013 11:36:03 -0400 Subject: [tv13.list] Instance search submission webpage open Message-ID: <52026963.8080203@nist.gov> Hi, For participants in the instance search task ... The submission webpage noted in the guidelines section http://www-nlpir.nist.gov/projects/tv2013/tv2013.html#ins is now open for test submissions. This year's submissions will be checked by software at the point of submission and rejected if problems are found. Please, therefore, plan on submitting early using the "TEST" team even before your final output is ready. Runs submitted under the TEST team are checked and error information returned, but the run is then discarded. Reminder - final instance search submissions under your actual team ID are due at NIST no later 23. August. Late submissions will not be accepted. - Paul -- Paul Over ---------------------------------------------- Retrieval Group Information Access Division Information Technology Laboratory National Institute of Standards and Technology Gaithersburg, MD 20899-8940 USA Bldg. 225 Rm. A211 (Mailstop 8940) Voice: 301 975-6784 Fax: 301 975-5287 From byhuang at whu.edu.cn Sun Aug 11 21:46:33 2013 From: byhuang at whu.edu.cn (byhuang at whu.edu.cn) Date: Mon, 12 Aug 2013 09:46:33 +0800 Subject: [tv13.list] video length mismatch problem Message-ID: <6054655.2530061376271993969.JavaMail.coremail@app2> Hi all, This is NERCMS team in Wuhan University.We participate in the instance search task, and use the BBC Eastenders data. I played all the videos with mplayer, and found four videos abnormal. The video length in mplayer is longer or shorter than in the ?Master shot reference?. As is shown in the table below. Video ID mplayer Master shot reference 5219838681845868979. mp4 (51th) 1:59:21 01:27:08 5440689765680991449. mp4 (138th) 1:55:38 02:25:02 5443278342466100962. mp4 (139th) 1:55:10 00:59:27 5658849193503292805. mp4 (226th) 1:27:23 01:53:20 I want to ask you how I should deal with these videos. ----------- Best Regards! Bingyue Huang Wuhan University -------------- next part -------------- An HTML attachment was scrubbed... URL: https://email.nist.gov/mailman/private/tv13.list/attachments/20130812/c5416649/attachment.html From andrei.bursuc at telecom-sudparis.eu Thu Aug 15 01:32:34 2013 From: andrei.bursuc at telecom-sudparis.eu (Andrei Bursuc) Date: Thu, 15 Aug 2013 08:32:34 +0300 Subject: [tv13.list] video length mismatch problem In-Reply-To: <6054655.2530061376271993969.JavaMail.coremail@app2> References: <6054655.2530061376271993969.JavaMail.coremail@app2> Message-ID: Hi, I have just tested the videos that you mentioned and they correspond to the mastershot metadata provided by NIST and BBC. I have used VLC player for that. Maybe you have set a different frame rate for your mplayer. The videos from the Eastenders dataset are all at 25 fps. Regards, Andrei Bursuc -- [image: T?l?com SudParis] *Andrei BURSUC* Research and Development Engineer Tel: +33 (0)6 77 50 87 20 9 rue Charles Fourier 91011 Evry, France [image: Site web] [image: Twitter][image: Google+] [image: Blog] On Mon, Aug 12, 2013 at 4:46 AM, wrote: > Hi all, > > > This is NERCMS team in Wuhan University.We participate in the instance > search task, and use the BBC Eastenders data. > I played all the videos with mplayer, and found four videos abnormal. > The video length in mplayer is longer or shorter than in > the ?Master shot reference?. As is shown in the table below. > > Video ID**** > > mplayer**** > > Master shot reference**** > > 5219838681845868979. mp4**** > > (51th)**** > > 1:59:21**** > > 01:27:08**** > > 5440689765680991449. mp4**** > > (138th)**** > > 1:55:38**** > > 02:25:02**** > > 5443278342466100962. mp4**** > > (139th)**** > > 1:55:10**** > > 00:59:27**** > > 5658849193503292805. mp4**** > > (226th)**** > > 1:27:23**** > > 01:53:20**** > > I want to ask you how I should deal with these videos. > > ----------- > Best Regards! > Bingyue Huang > Wuhan University > > > > > _______________________________________________ > tv13.list mailing list > tv13.list at nist.gov > https://email.nist.gov/mailman/listinfo/tv13.list > > -------------- next part -------------- An HTML attachment was scrubbed... URL: https://email.nist.gov/mailman/private/tv13.list/attachments/20130815/7d86817f/attachment.html From over at nist.gov Thu Aug 15 10:16:12 2013 From: over at nist.gov (Paul Over) Date: Thu, 15 Aug 2013 10:16:12 -0400 Subject: [tv13.list] Instance search submission - file ID 0 not part of test set Message-ID: <520CE2AC.6030501@nist.gov> Hi, For participants in the instance search task... We have received a number of submissions - that is good. However they contain result items from file ID 0, which, as the collection.xml file indicates, is NOT part of the test collection. It is a sample. 0 5082189274976367100.mp4 sample BBC MPEG-4 Unfortunately the submission checker was not checking this. The checker has been corrected and we will assume that the JRS, NERCMS, and TNO teams will want to correct their submissions and resubmit. Therefore we will move the current submissions out of the way Sorry for the confusion. Thanks, Paul -- Paul Over ---------------------------------------------- Retrieval Group Information Access Division Information Technology Laboratory National Institute of Standards and Technology Gaithersburg, MD 20899-8940 USA Bldg. 225 Rm. A211 (Mailstop 8940) Voice: 301 975-6784 Fax: 301 975-5287 From over at nist.gov Mon Aug 19 07:35:00 2013 From: over at nist.gov (Paul Over) Date: Mon, 19 Aug 2013 07:35:00 -0400 Subject: [tv13.list] INS submissions - only 4 official runs per team Message-ID: <521202E4.1030105@nist.gov> Hi, Reminder, instance task submissions are due by Friday. You may use the TEST team ID to submit as many runs as you want for testing (none will be kept). But please do not submit more than the allowed 4 runs per team when using your actual team ID. Thanks, Paul -- Paul Over ---------------------------------------------- Retrieval Group Information Access Division Information Technology Laboratory National Institute of Standards and Technology Gaithersburg, MD 20899-8940 USA Bldg. 225 Rm. A211 (Mailstop 8940) Voice: 301 975-6784 Fax: 301 975-5287 From over at nist.gov Wed Aug 21 11:23:25 2013 From: over at nist.gov (Paul Over) Date: Wed, 21 Aug 2013 11:23:25 -0400 Subject: [tv13.list] Instance search submission checker error - for interactive runs In-Reply-To: <5214CCAF.2040709@iti.gr> References: <52026963.8080203@nist.gov> <5214CCAF.2040709@iti.gr> Message-ID: <5214DB6D.6080909@nist.gov> Hi, Natasa Moumtzidou has pointed out that the INS submission checker is requiring results for all 30 topics from interactive runs, which should only be concerned with the first 24. This will be fixed by noon tomorrow here. The code is changed but updating the server requires staff who are out today. Sorry for the delay. - Paul -- Paul Over ---------------------------------------------- Retrieval Group Information Access Division Information Technology Laboratory National Institute of Standards and Technology Gaithersburg, MD 20899-8940 USA Bldg. 225 Rm. A211 (Mailstop 8940) Voice: 301 975-6784 Fax: 301 975-5287 From over at nist.gov Mon Aug 26 13:44:01 2013 From: over at nist.gov (Paul Over) Date: Mon, 26 Aug 2013 13:44:01 -0400 Subject: [tv13.list] Instance search submissions received Message-ID: <521B93E1.2090606@nist.gov> Hi, We've received the following 70 instance search runs from 21 teams. each run name is made up of the following: processing type _ condition _ sysID _ priority. Please let me (over at nist.gov) know directly if your runs are not represented as expected. Thanks, Paul F_NO_ARTEMIS_1_1 F_NO_ARTEMIS_2_2 F_NO_ARTEMIS_3_3 F_NO_ARTEMIS_4_4 F_NO_BUPT_MCPRL_2 F_NO_BUPT_MCPRL_3 F_NO_CeaList_1 F_NO_CeaList_2 F_NO_CeaList_3 F_NO_CeaList_4 F_NO_FTRDBJ_1 F_NO_FTRDBJ_2 F_NO_FTRDBJ_3 F_NO_iAD_DCU_1 F_NO_iAD_DCU_2 F_NO_iAD_DCU_3 F_NO_iAD_DCU_4 F_NO_IRIM_1_1 F_NO_IRIM_2_2 F_NO_IRIM_3_3 F_NO_IRIM_4_4 F_NO_jrs1_1 F_NO_jrs2_2 F_NO_MIC_TJ_1 F_NO_MIC_TJ_2 F_NO_MMBajie_2 F_NO_MMShaseng_3 F_NO_MMShifu_4 F_NO_MMWukong_1 F_NO_NERCMS_1 F_NO_NERCMS_2 F_NO_NERCMS_3 F_NO_NERCMS_4 F_NO_NII-AsymDis_Cai-Zhi_2 F_NO_NII-AvgDist_Cai-Zhi_3 F_NO_NII-GeoRerank_Cai-Zhi_1 F_NO_NII-UIT.BOW-DPM_4 F_NO_NTT_NII_1 F_NO_NTT_NII_2 F_NO_NTT_NII_3 F_NO_NTT_NII_4 F_NO_orand-1sift_4 F_NO_orand-2sift_3 F_NO_orand-graph_1 F_NO_PKU-ICST-MIPL_1 F_NO_PKU-ICST-MIPL_3 F_NO_PKU-ICST-MIPL_4 F_NO_ridl_m_2q_1 F_NO_ridl_m_2q_r_2 F_NO_ridl_m_q_3 F_NO_ridl_m_q_r_4 F_NO_sheffield_1 F_NO_sheffield_2 F_NO_sheffield_3 F_NO_TNOM3-SHOTBFSIFT_1 F_NO_TokyoTech1_1 F_NO_TokyoTech2_2 F_NO_vireo_dt_2 F_NO_vireo_dtc_1 F_NO_vireo_dtcm_3 F_NO_vireo_dtm_4 I_NO_AXES_1_1 I_NO_AXES_2_2 I_NO_AXES_3_3 I_NO_FTRDBJ_4 I_NO_orand-interactive_2 I_NO_PKU-ICST-MIPL_2 I_YES_ITI_CERTH_1 I_YES_ITI_CERTH_2 I_YES_ITI_CERTH_3 -- Paul Over ---------------------------------------------- Retrieval Group Information Access Division Information Technology Laboratory National Institute of Standards and Technology Gaithersburg, MD 20899-8940 USA Bldg. 225 Rm. A211 (Mailstop 8940) Voice: 301 975-6784 Fax: 301 975-5287