2010 Signal Separation Evaluation Campaign
Professionally produced music recordings
Development database

For details about each algorithm, click on the algorithm number.

All estimated source signals are made available under the terms of the same license as the mixture signals. For licensing information regarding the mixture signals, see the bottom of this page.



Average results
      vocals         drums         bass         guitar         claps         total    
Algorithm 1
A. Ozerov, R. Blouet & C. Fevotte		 SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi     
TPSi     
IPSi     
APSi     		   1.7
  9.0
  5.2
  4.2

25.6
47.0
44.9
52.6
   2.3
  6.6
  5.7
  3.1

34.3
57.1
62.1
51.0
   2.5
  5.6
10.4
  0.9

13.6
52.4
38.3
17.8
   1.8
  3.7
  5.4
  2.8

30.1
19.3
47.4
63.4
   2.0
  3.4
20.2
  2.3

29.2
63.0
69.9
27.6
   2.1
  6.5
  7.9
  2.9

26.6
49.9
51.5
43.7
Algorithm 2
J. Janer & R. Marxer		 SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi     
TPSi     
IPSi     
APSi     		   0.9
11.2
  Inf
 -0.8

24.9
56.4
89.6
  6.0
 -
-
-
-

-
-
-
-		 -
-
-
-

-
-
-
-		 -
-
-
-

-
-
-
-		 -
-
-
-

-
-
-
-		 -
-
-
-

-
-
-
-
Algorithm 3
M. Spiertz		 SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi     
TPSi     
IPSi     
APSi     		   2.3
  3.9
  7.0
  3.6

17.9
28.3
28.5
50.6
   3.8
  7.2
  7.7
  6.3

27.7
46.8
49.1
52.5
   3.1
11.4
  7.2
  4.3

  6.1
60.6
  7.9
23.6
   3.5
12.4
  4.0
  8.7

10.3
28.8
  6.1
75.3
   4.9
11.2
  9.5
  5.7

14.0
75.2
19.3
48.7
   3.3
  8.0
  7.2
  5.3

17.3
45.0
27.4
48.1
STFT
Ideal Binary Mask		 SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi     
TPSi     
IPSi     
APSi     		   6.6
20.1
22.4
  6.7

30.8
57.4
67.6
31.8
   6.5
16.6
18.7
  6.4

44.1
70.3
76.1
45.0
   4.9
17.9
15.9
  5.6

12.9
69.4
59.7
  7.1
   8.5
17.8
15.7
  8.9

38.1
30.8
71.8
43.1
   7.6
19.6
29.4
  7.5

29.3
90.5
77.6
19.4
   6.5
18.3
20.0
  6.7

31.8
64.3
70.0
30.7
Cochleagram
Ideal Binary Mask		 SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi     
TPSi     
IPSi     
APSi     		   4.9
15.3
18.3
  4.9

17.2
39.2
52.6
17.0
   1.8
  3.2
16.7
  2.3

36.4
58.8
69.7
38.9
   0.9
  1.7
13.6
 -1.1

24.7
37.8
64.0
23.7
   4.5
  7.0
11.4
  5.3

25.5
16.7
60.6
28.7
   7.9
17.7
26.0
  8.0

56.2
89.0
81.9
58.1
   3.5
  8.4
17.0
  3.3

29.2
47.5
63.8
30.2


Detailed results
  Another Dreamer
"The Ones We Love"
mix

 vocals 

 drums 

 guitar 

Fort Minor
"Remember the Name"
mix

 vocals 

 drums 

 bass 

 claps 


"Ultimate NZ Tour"
mix

 vocals 

 drums 

 bass 

Algorithm 1
A. Ozerov, R. Blouet & C. Fevotte
SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi     
TPSi     
IPSi     
APSi     

 vocals 

 drums 

 guitar 

 -0.7   0.9   1.8
  8.3   2.2   3.7
 -1.9   3.8   5.4
  6.6   0.8   2.8

33.3 34.2 30.1
52.5 61.8 19.3
49.1 59.4 47.4
74.7 57.6 63.4

 vocals 

 drums 

 bass 

 claps 

  3.2   2.0   4.2   2.0
  9.2   6.5   9.6   3.4
  9.4   4.7   7.1 20.2
  3.3   3.4   5.6   2.3

24.2 41.6 15.9 29.2
53.6 58.7 62.1 63.0
46.5 70.1 45.9 69.9
45.8 56.2 19.5 27.6

 vocals 

 drums 

 bass 

  2.6   4.2   0.7
  9.6 11.1   1.6
  8.1   8.8 13.6
  2.6   5.1  -3.9

19.4 27.0 11.2
34.9 50.7 42.8
39.1 56.7 30.7
37.3 39.3 16.0
Algorithm 2
J. Janer & R. Marxer
SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi     
TPSi     
IPSi     
APSi     

 vocals 

       

        

  3.1 - -
11.0 - -
  Inf - -
  1.6 - -

37.1 - -
49.9 - -
89.6 - -
12.7 - -

 vocals 

       

      

       

  1.4 - - -
11.5 - - -
  Inf - - -
 -0.3 - - -

22.9 - - -
59.4 - - -
89.6 - - -
  3.9 - - -

 vocals 

       

      

 -1.7 - -
11.1 - -
  Inf - -
 -3.8 - -

14.7 - -
59.8 - -
89.6 - -
  1.3 - -
Algorithm 3
M. Spiertz
SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi     
TPSi     
IPSi     
APSi     

 vocals 

 drums 

 guitar 

  2.0   4.0   3.5
  3.6   7.9 12.4
  5.3   6.7   4.0
  2.8   8.8   8.7

20.5 24.0 10.3
29.7 50.6 28.8
24.7 32.4   6.1
71.4 71.6 75.3

 vocals 

 drums 

 bass 

 claps 

  3.9   2.7   5.3   4.9
  5.7   6.0 13.1 11.2
15.7   5.6   7.6   9.5
  5.2   4.0   8.4   5.7

22.6 36.3   5.6 14.0
29.2 51.3 82.7 75.2
48.9 66.6   5.5 19.3
35.2 48.8 27.9 48.7

 vocals 

 drums 

 bass 

  0.9   4.7   1.0
  2.6   7.7   9.7
 -0.0 10.8   6.7
  2.9   6.2   0.2

10.7 22.8   6.7
25.9 38.3 38.4
11.8 48.4 10.3
45.3 37.0 19.4
STFT
Ideal Binary Mask
SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi     
TPSi     
IPSi     
APSi     

 vocals 

 drums 

 guitar 

  8.5   8.8   8.5
15.5 17.1 17.8
18.4 20.1 15.7
  9.0   8.9   8.9

41.2 56.4 38.1
55.9 74.6 30.8
72.5 80.8 71.8
50.1 61.7 43.1

 vocals 

 drums 

 bass 

 claps 

  7.2   4.5   7.1   7.6
22.7   9.3 19.3 19.6
26.5 13.4 11.0 29.4
  7.0   4.2   9.2   7.5

34.4 48.8 12.0 29.3
69.3 74.1 100.0 90.5
76.1 81.8 66.2 77.6
29.5 45.1   4.3 19.4

 vocals 

 drums 

 bass 

  4.2   6.2   2.7
22.1 23.5 16.5
22.2 22.4 20.7
  4.0   6.2   2.0

16.9 27.2 13.8
46.8 62.3 38.8
54.1 65.7 53.3
15.7 28.2   9.8
Cochleagram
Ideal Binary Mask
SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi     
TPSi     
IPSi     
APSi     

 vocals 

 drums 

 guitar 

  6.7   1.0   4.5
11.9   1.4   7.0
14.9 17.4 11.4
  7.5   2.8   5.3

21.3 46.5 25.5
38.5 68.3 16.7
52.4 76.6 60.6
27.9 52.3 28.7

 vocals 

 drums 

 bass 

 claps 

  5.6   2.2   0.4   7.9
16.1   3.3   0.5 17.7
22.6 14.1   9.9 26.0
  5.2   1.8  -0.8   8.0

18.9 43.5 24.2 56.2
54.7 65.7 42.2 89.0
64.8 77.5 62.4 81.9
12.8 44.4 24.4 58.1

 vocals 

 drums 

 bass 

  2.6   2.3   1.4
18.0   5.0   3.0
17.5 18.6 17.3
  2.0   2.2  -1.4

11.4 19.3 25.2
24.4 42.3 33.4
40.6 55.1 65.6
10.3 19.9 23.0

All audio files are distributed under the terms different licenses, as listed below for each recodring:

Using these audio files for any purposes that are not scientific research is explicitly prohibited.