Stereo Audio Source Separation Evaluation Campaign
 
Evaluation criteria
Objective criteria
We propose to evaluate the results using three objective criteria, extending those of the BSS Eval toolbox to multichannel signals. These criteria can be computed for all types of separation algorithms and do not necessitate knowledge of the separating filters or masks. The quality of the estimated spatial image s_est_ij(t) of source j on channel i, that is the estimated contribution of this source to the observed mixture in this channel, is assessed by the decomposition
The relative amounts of spatial distortion, interference and artifacts are then measured using three energy ratio criteria expressed in decibels (dB)
Matlab implementation
The above criteria were implemented in Matlab as a collection of two Mfiles distributed under the terms of the GNU Public License:
Representing the estimated spatial image of source j by a matrix se of size 2*160000 and the true spatial images of all sources by a matrix S of size 2*160000*3 or 2*160000*4 (depending on the number of sources), the criteria can be computed via
[s_true,e_spat,e_interf,e_artif]=bss_decomp_mtifilt(se,S,j,512); [ISR,SIR,SAR]=bss_mcrit(s_true,e_spat,e_interf,e_artif); Additional criteria
We welcome any additional criteria proposed by the participants.
