Preliminary MED 2014 Scores

• Pre-Specified Systems

  
  

  			Scores on MED14Eval Full (200K videos)												Scores on MED14Eval Sub (32K videos)
  		MED R0	MED R0												MED R0
  			noPRF								PRF				noPRF								PRF
  			SQ		000Ex		010Ex		100Ex		000Ex		010Ex		SQ		000Ex		010Ex		100Ex		000Ex		010Ex
  		System Description	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max
  Teams that processed MED14Full	ATTLabs	MED14Full_PS_010Ex_2.txt					8.1	13.3	14.3	21.1									7.3	13.1	14.7	21.6
  	AXES	MED14Full_PS_010Ex_2.txt					32.2	38.3	51.3	56.7									32.1	38.8	49.4	56.2
  	Aurora	MED14Full_PS_000Ex_3.txt	5.2	12.2	5.2	12.2	* 32.5	* 34.7	* 43.4	* 51.1					6.1	13.9	6.0	13.9	* 31.0	* 35.3	* 42.5	* 51.4
  	BBNVISER	MED14Full_PS_000Ex_2.txt	20.3	24.0	24.3	27.4	41.7	43.7	56.3	58.0					20.8	25.1	25.5	29.3	41.0	44.5	54.8	57.8
  	CMU	MED14Full_PS_000Ex_2.txt	27.6	37.7	28.9	39.1	37.8	45.3	52.9	61.8	33.0	43.4	36.0	46.3	27.8	39.3	30.1	41.7	37.5	47.0	52.3	62.3	33.6	44.6	35.8	47.6
  	Fudan	MED14Full_PS_010Ex_2.txt					+ 0.0	+ 28.2	+ 0.0	+ 47.0									+ 0.0	+ 28.8	+ 0.0	+ 47.1
  	INRIA-LIM-VocR	MED14Full_PS_010Ex_2.txt					33.9	39.6	51.8	58.4									34.6	40.6	50.3	58.3
  	MediaMill	MED14Full_PS_010Ex_2.txt	5.8	18.8			34.8	37.2	51.6	53.6					4.5	20.0			33.4	38.2	48.8	52.7
  	NII	MED14Full_PS_010Ex_1.txt					17.5	24.1	35.4	44.5									16.3	24.9	36.2	45.6
  	Sesame	MED14Full_PS_010Ex_2.txt	-157.0	22.4			41.9	44.5	58.7	63.0					-159.7	22.5			39.7	44.6	57.0	62.7
  	TokyoTech	MED14Full_PS_010Ex_2.txt					18.3	24.7	39.7	45.5									18.0	26.2	37.7	46.3
  	VIREO	MED14Full_PS_000Ex_2.txt	8.5	20.0	8.8	18.7	32.9	36.2	48.1	51.8					7.4	19.4	8.0	19.0	32.6	36.8	46.3	51.5
  Teams that processed MED14Sub	ITI_CERTH	MED14Sub_PS_010Ex_2.txt																	26.8	30.2	38.6	50.8
  	KU-ISPL	MED14Sub_PS_010Ex_5.txt																	+ -0.5	+ 3.8	+ 2.6	+ 9.1
  	MCIS	MED14Sub_PS_010Ex_4.txt																	21.6	35.2
  	MIC	MED14Sub_PS_000Ex_4.txt															* -793.5	* -0.0	* -564.5	* 0.8	* -552.6	* 8.2
  	ORAND	MED14Sub_PS_010Ex_2.txt																	0.4	2.0	3.1	7.0

  
  
  

• Pre-Adjudicated Ad-Hoc Systems

  
  

  			Scores on MED14Eval Full (200K videos)														Scores on MED14Eval Sub (32K videos)
  		MED R0	MED R0														MED R0
  			noPRF								PRF						noPRF								PRF
  			SQ		000Ex		010Ex		100Ex		SQ		000Ex		010Ex		SQ		000Ex		010Ex		100Ex		SQ		000Ex		010Ex
  		System Description	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max	Act	Max
  Teams that processed MED14Full	ATTLabs	MED14Full_AH_010Ex_2.txt					0.2	1.7	13.0	16.8											2.7	4.2	18.3	23.5
  	AXES	MED14Full_AH_010Ex_2.txt					4.5	38.3	39.4	47.0											4.5	35.3	34.5	43.0
  	Aurora	MED14Full_AH_000Ex_4.txt	5.0	6.5	* 5.0	* 6.5	* 19.7	* 25.4	* 32.8	* 42.5	1.6	2.9	* -466.8	* 4.1			4.7	6.5	* 4.7	* 6.5	* 17.8	* 23.9	* 30.2	* 39.7	2.0	3.2	* -467.9	* 3.7
  	BBNVISER	MED14Full_AH_000Ex_2.txt	11.7	16.6	14.7	17.8	33.3	35.4	46.9	48.4							10.3	15.2	13.5	16.5	30.4	33.5	42.9	44.5
  	CMU	MED14Full_AH_000Ex_2.txt	17.3	29.7	17.3	29.7	26.3	32.1	42.4	51.7			23.1	37.8	27.2	35.8	16.0	27.7	16.0	27.7	23.5	29.8	39.0	48.5			21.9	36.0	24.7	32.8
  	Fudan	MED14Full_AH_010Ex_2.txt					0.0	21.9	0.0	41.4											0.0	20.3	0.0	38.4
  	INRIA-LIM-VocR	MED14Full_AH_010Ex_2.txt					6.2	38.5	42.0	48.1											5.8	35.4	37.0	43.9
  	MediaMill	MED14Full_AH_010Ex_2.txt	2.1	10.2			22.7	25.4	42.7	45.1							0.8	9.9			20.7	23.9	39.1	41.6
  	NII	MED14Full_AH_010Ex_1.txt					11.5	18.3	31.6	37.1											10.1	17.7	29.2	34.6
  	Sesame	MED14Full_AH_010Ex_4.txt	2.0	9.5			* 30.8	* 33.3	* 50.9	* 52.8							1.0	9.1			* 28.4	* 31.5	* 47.9	* 50.9
  	TokyoTech	MED14Full_AH_010Ex_2.txt					14.2	18.8	37.0	40.9											13.9	18.1	32.5	36.5
  	VIREO	MED14Full_AH_000Ex_2.txt	3.3	7.3	4.9	7.4	21.6	23.3									3.0	7.3	5.1	7.9	20.9	22.4
  Teams that processed MED14Sub	ITI_CERTH	MED14Sub_AH_010Ex_2.txt																			20.1	22.2	27.8	42.6
  	KU-ISPL	MED14Sub_AH_010Ex_4.txt																			+ 0.9	+ 2.0	+ 1.7	+ 2.5
  	MCIS	MED14Sub_AH_010Ex_2.txt																			10.7	25.2
  	MIC	MED14Sub_AH_000Ex_2.txt																	-574.8	-0.0	-562.1	0.6	-548.3	5.3
  	ORAND	MED14Sub_AH_010Ex_2.txt																			1.7	5.0	3.9	11.1

  
  * - Debugged submission
  + - Late Submission

Update history:

• 2014.10.07 - Initial release