SiSEC

2010 Signal Separation Evaluation Campaign

Source separation in the presence of real-world background noise

Test database for 2 channels case

For details about each algorithm, please click on the algorithm number.

The results are organized by follows

Table of Averages
Average Metrics for different mixtures
Subway Noise
Subway Noise, with 2 channels, 1 src
Subway Noise, with 2 channels, 3 srcs
Cafeteria Noise
Cafeteria Noise, with 2 channels, 1 src
Cafeteria Noise, with 2 channels, 3 srcs
Square Noise
Square Noise, with 2 channels, 1 src
Square Noise, with 2 channels, 3 srcs

Notes:

Average metrics were computed for the source estimates only ( ignoring the noise)
We used the permutation results of BSSEVAL to correctly align the results and the tables below accounts for any alignment adjustments.
Algorithm number 3 showed "Inf" SIR for the case of 1 source because only speech estimate was available and Signal to Interference ratio could not be computed. For the 3 sources case, the SIR was computed by ignoring "noise" as interference.

Average Results for 2 channels

Return to top

1 src, Subway

1 src, Cafeteria

1 src, Square

3 src, Subway

3 src, Cafeteria

3 src, Square

Algorithm 1
N. Duong

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi


-
-
-

-2.6
16.4
-1.9
10.3

29.3
70.2
36.5
84.3


-
-
-

8.2
13.4
11.2
15.2

30.2
61.6
36.5
90.4


-
-
-

2.4
18.5
3.8
10.3

49.4
77.7
62.8
90.1


-
-
-

-1.2
5.7
-1.7
7.0

13.3
36.3
15.1
60.2


-
-
-

1.3
5.5
1.6
8.1

15.5
38.0
18.0
62.3


-
-
-

3.7
9.8
6.0
8.2

27.0
52.5
38.0
67.5

Algorithm 2
J. Even, H. Saruwatari & K. Shikano

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi


-0.3
-
-0.3

-9.6
-6.1
5.2
7.9

24.8
36.8
42.8
48.7


3.3
-
3.3

-8.3
-7.0
19.3
8.1

34.0
37.2
57.0
56.9


9.0
-
9.0

-10.0
-8.6
17.7
7.9

41.5
75.6
66.6
55.8

Algorithm 3
Dang Hai Tran Vu

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi


0.3
-
0.3

-
-
-
-

-
-
-
-


0.4
-
0.4

-
-
-
-

-
-
-
-


8.7
-
8.7

-
-
-
-

-
-
-
-


-0.6
4.5
3.3

-
-
-
-

-
-
-
-


-1.1
4.2
3.4

-
-
-
-

-
-
-
-


3.1
7.0
8.3

-
-
-
-

-
-
-
-

Algorithm 4
M. Go, H. Saruwatari, T. Inoue & K. Shikano

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi


-21.0
-
-21.0

-12.9
-6.5
-0.9
8.2

14.3
32.7
24.3
37.0


-19.0
-
-19.0

-10.3
-9.3
15.7
10.5

21.9
26.1
40.2
43.9


-18.6
-
-18.6

-13.5
-7.4
3.8
7.8

21.7
46.9
40.0
40.8

Algorithm 5
N. Hirata, H. Saruwatari, T. Inoue & K. Shikano

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi


-14.8
-
-14.8

-10.9
-2.2
-2.2
7.1

9.3
46.3
17.0
23.7


-13.8
-
-13.8

-6.1
-3.3
13.6
5.5

21.3
36.2
45.5
34.3


-7.0
-
-7.0

-8.7
-4.2
11.2
3.5

18.3
35.8
43.0
26.8

Algorithm 6
H. Sawada

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi


-
-
-

-2.4
14.3
-1.4
10.4

29.8
71.4
41.1
65.8


-
-
-

9.1
15.7
11.9
14.9

35.5
70.4
48.8
81.0


-
-
-

0.8
18.0
1.6
13.2

49.8
78.5
63.7
88.4

STFT
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

16.8

27.7

26.3

15.5

16.6

30.2

24.7

16.0

14.6

26.6

23.6

14.0

9.6

18.8

21.0

7.3

10.1

20.2

20.4

7.9

10.3

20.8

21.8

8.0

Cochleagram
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

14.4

25.0

22.3

15.5

14.4

26.4

20.1

16.0

12.4

22.0

20.4

14.0

7.2

14.2

17.5

7.3

7.7

15.3

17.1

7.9

15.6

18.1

8.0

Detailed Results for Subway Noise, with 2 channels, 1 src

Return to top

Test1 1src_Su_Ce_A
mix

Test2 1src_Su_Ce_A
mix

Test1 1src_Su_Ce_B
mix

Test2 1src_Su_Ce_B
mix

Algorithm 1
N. Duong

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
115.0	-
-	-

-	-
-	-
-	-

-10.2	2.2
11.0	2.5
-9.8	24.8
11.2	7.6

13.2	46.5
67.0	6.9
9.5	68.2
82.1	67.2

src1	src2
120.0	-
-	-

-	-
-	-
-	-

2.8	5.9
13.2	7.2
3.8	14.7
10.8	11.2

41.4	20.2
70.0	8.4
54.6	25.5
90.8	64.6

src1	src2
85.0	-
-	-

-	-
-	-
-	-

-9.8	6.1
12.8	7.3
-9.1	26.1
4.7	9.4

21.6	53.3
72.5	9.3
26.3	74.4
76.5	69.1

src1	src2
45.0	-
-	-

-	-
-	-
-	-

6.8	4.9
28.7	5.8
7.6	24.5
14.5	9.1

41.0	28.9
71.5	7.7
55.4	45.3
87.8	61.1

Algorithm 2
J. Even, H. Saruwatari & K. Shikano

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
115.0	-
117.0	-

-1.8	-
Inf	-
-1.8	-

-9.3	-1.2
-5.3	-1.1
3.5	23.1
8.1	23.1

16.3	39.4
37.8	6.9
27.6	59.2
42.4	68.2

src1	src2
120.0	-
125.0	-

-3.2	-
Inf	-
-3.2	-

-14.7	-14.5
-10.7	-13.2
1.3	5.7
8.6	14.9

35.3	22.2
39.6	7.8
59.3	25.4
56.2	75.8

src1	src2
85.0	-
94.0	-

0.8	-
Inf	-
0.8	-

-10.0	-1.3
-6.5	-1.3
4.0	29.8
7.3	23.1

17.4	62.6
35.2	4.4
26.4	76.3
50.3	80.8

src1	src2
45.0	-
54.0	-

3.2	-
Inf	-
3.2	-

-4.3	-15.5
-2.1	-14.0
12.1	4.5
7.7	16.7

30.3	17.1
34.5	9.4
58.1	16.3
45.8	74.3

Algorithm 3
Dang Hai Tran Vu

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
115.0	-
126.0	-

-4.1	-
Inf	-
-4.1	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
120.0	-
126.0	-

3.4	-
Inf	-
3.4	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
85.0	-
93.0	-

-1.2	-
Inf	-
-1.2	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
45.0	-
52.0	-

3.1	-
Inf	-
3.1	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

Algorithm 4
M. Go, H. Saruwatari, T. Inoue & K. Shikano

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
115.0	-
119.0	-

-15.4	-
Inf	-
-15.4	-

-10.7	4.1
-5.6	4.4
0.8	27.6
10.4	19.6

8.7	41.7
39.8	3.8
11.5	67.7
31.3	55.3

src1	src2
120.0	-
126.0	-

-23.8	-
Inf	-
-23.8	-

-14.5	-18.5
-6.9	-12.2
-2.4	12.9
6.1	-3.4

19.7	24.2
31.2	6.7
35.7	47.8
43.7	39.6

src1	src2
85.0	-
94.0	-

-21.4	-
Inf	-
-21.4	-

-16.1	4.5
-9.3	5.3
-2.6	33.1
9.4	16.5

11.6	52.0
31.3	4.7
16.3	77.0
37.8	57.7

src1	src2
45.0	-
53.0	-

-23.4	-
Inf	-
-23.4	-

-10.1	-15.7
-4.3	-10.3
0.7	11.3
6.9	-1.5

17.1	16.2
28.5	9.5
33.7	33.0
35.0	31.2

Algorithm 5
N. Hirata, H. Saruwatari, T. Inoue & K. Shikano

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
115.0	-
116.0	-

-12.3	-
Inf	-
-12.3	-

-9.0	-1.5
-0.6	-1.1
-1.0	24.8
6.7	15.8

7.4	46.3
51.9	3.4
15.6	66.3
15.8	69.5


-	-
-	-

-	-
-	-
-	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
85.0	-
94.0	-

-17.2	-
Inf	-
-17.2	-

-12.7	-1.1
-3.8	-0.9
-3.3	30.4
7.5	17.5

11.2	65.0
40.6	3.4
18.3	78.0
31.6	79.7


-	-
-	-

-	-
-	-
-	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

Algorithm 6
H. Sawada

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
115.0	-
-	-

-	-
-	-
-	-

-8.5	4.5
11.3	5.3
-7.7	23.5
7.5	6.9

13.2	28.8
71.6	13.7
18.8	61.7
45.2	35.5

src1	src2
120.0	-
-	-

-	-
-	-
-	-

3.1	5.9
14.5	7.2
4.0	15.1
11.7	10.6

47.6	35.4
74.4	12.5
64.1	54.3
86.9	67.2

src1	src2
85.0	-
-	-

-	-
-	-
-	-

-12.1	4.7
15.3	5.6
-11.2	25.9
6.6	6.9

14.2	36.8
67.6	12.4
20.9	71.0
45.7	40.1

src1	src2
45.0	-
-	-

-	-
-	-
-	-

7.9	6.0
16.2	7.7
9.2	12.5
15.7	11.1

44.0	26.0
72.1	9.7
60.4	40.8
85.4	58.6

STFT
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2
17.6	30.7
27.1	39.3
26.2	40.3
18.7	31.9

src1	src2
14.7	18.1
28.1	27.7
24.2	31.6
15.3	18.7

src1	src2
13.8	30.7
23.1	41.4
24.4	40.0
14.6	31.7

src1	src2
21.0	19.6
32.6	28.8
30.2	31.2
21.8	20.4

Cochleagram
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2
15.7	0.3
26.4	0.4
22.2	17.4
17.2	-0.3

src1	src2
12.5	1.0
25.0	1.1
21.3	20.1
13.1	6.4

src1	src2
11.9	0.3
22.2	0.4
20.0	17.8
12.9	-0.2

src1	src2
17.5	1.0
26.3	1.2
25.6	16.5
18.9	6.1

Detailed Results for Subway Noise, with 2 channels, 3 srcs

Return to top

Test1 3src_Su_Ce_A
mix

Test2 3src_Su_Ce_A
mix

Test1 3src_Su_Ce_B
mix

Test2 3src_Su_Ce_B
mix

Algorithm 1
N. Duong

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2	src3	src4
20.0	85.0	120.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

-10.1	0.7	-6.4	1.9
4.4	6.0	9.0	2.1
-13.7	-0.1	-6.5	16.1
7.9	5.9	6.2	8.3

11.6	13.1	13.1	7.8
43.8	48.0	38.4	10.0
11.1	13.8	12.2	6.3
57.4	58.6	64.2	42.5

src1	src2	src3	src4
115.0	45.0	85.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

-1.1	3.0	1.3	2.1
0.6	5.3	3.3	9.1
-7.2	6.5	0.9	1.1
7.5	8.0	5.6	11.0

4.6	32.0	16.5	6.1
15.4	54.8	42.3	19.8
2.0	48.2	21.3	2.4
43.7	71.9	57.4	64.2

src1	src2	src3	src4
85.0	120.0	45.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

-3.8	-5.1	2.1	1.9
2.4	12.7	2.5	4.4
-9.4	-5.0	10.6	4.0
4.0	7.9	7.8	6.6

8.3	19.4	8.2	14.3
33.0	56.1	12.1	38.7
6.2	25.0	6.2	16.1
50.5	66.5	47.9	58.3

src1	src2	src3	src4
120.0	85.0	20.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

-1.0	4.6	1.8	1.4
2.8	7.8	11.9	2.2
-6.2	6.4	2.9	4.9
6.5	9.1	7.6	3.7

4.7	3.7	24.2	8.3
23.4	23.8	44.9	28.6
1.3	0.8	33.0	6.2
65.8	67.7	70.8	50.0

Algorithm 3
Dang Hai Tran Vu

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2	src3	src4
20.0	85.0	120.0	-
26.0	76.0	126.0	-

2.7	-1.2	-4.8	-
9.4	2.9	-1.2	-
4.2	2.7	1.3	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
115.0	45.0	85.0	-
91.0	120.0	52.0	-

4.3	-6.0	1.1	-
14.1	-3.2	6.9	-
4.9	2.1	3.2	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
85.0	120.0	45.0	-
52.0	83.0	125.0	-

-1.8	3.8	-7.3	-
2.3	12.5	-4.2	-
2.4	4.7	1.3	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
120.0	85.0	20.0	-
77.0	26.0	125.0	-

5.1	-0.8	-2.8	-
10.9	2.5	0.6	-
6.8	3.9	2.6	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

STFT
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2	src3	src4
9.2	8.2	6.9	22.0
17.2	18.0	13.9	31.1
22.0	17.3	19.8	31.7
9.4	8.4	6.5	23.2

src1	src2	src3	src4
12.0	12.9	9.8	19.0
21.9	24.1	18.6	24.5
23.1	23.6	22.2	30.5
12.4	13.3	10.0	20.8

src1	src2	src3	src4
8.5	8.8	11.9	22.1
17.5	16.9	22.1	31.1
19.0	23.0	23.2	31.6
8.6	8.8	12.5	23.2

src1	src2	src3	src4
7.8	9.3	10.1	18.0
16.4	20.0	19.0	24.1
19.0	18.3	22.2	31.8
7.7	9.7	10.4	19.4

Cochleagram
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2	src3	src4
6.3	6.2	4.9	0.4
11.9	13.3	9.6	0.5
17.9	14.6	16.9	11.8
6.2	6.1	4.5	1.9

src1	src2	src3	src4
9.3	10.5	7.1	0.4
17.9	19.2	13.9	0.4
17.9	21.1	18.3	10.3
9.7	11.0	7.2	0.2

src1	src2	src3	src4
6.3	6.0	9.8	0.4
12.7	11.3	18.7	0.5
15.7	18.2	19.5	12.3
6.2	5.9	10.3	1.3

src1	src2	src3	src4
5.8	7.1	7.5	0.3
12.0	16.0	14.4	0.4
16.7	14.8	18.2	11.3
5.5	7.4	7.5	-0.7

Detailed Results for Cafeteria Noise, with 2 channels, 1 src

Return to top

Test 1 1src_Ca_Ce_A
mix

Test 2 1src_Ca_Ce_A
mix

Test 1 1src_Ca_Ce_B
mix

Test 2 1src_Ca_Ce_B
mix

Test 1 1src_Ca_Co_A
mix

Test 2 1src_Ca_Co_A
mix

Test 1 1src_Ca_Co_B
mix

Test 2 1src_Ca_Co_B
mix

Algorithm 1
N. Duong

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
-	-

-	-
-	-
-	-

5.2	2.4
10.3	5.1
7.0	4.2
12.6	8.2

25.4	12.4
44.7	15.2
28.0	9.0
89.5	73.4

src1	src2
120.0	-
-	-

-	-
-	-
-	-

7.0	-1.1
9.8	3.9
11.3	-2.8
13.8	6.5

33.6	15.7
63.5	16.9
42.3	14.5
91.4	73.3

src1	src2
120.0	-
-	-

-	-
-	-
-	-

6.2	2.6
16.1	3.7
7.1	8.8
15.2	7.9

34.7	14.6
58.1	11.9
44.3	13.1
90.3	70.0

src1	src2
115.0	-
-	-

-	-
-	-
-	-

10.3	-1.8
12.5	5.0
16.7	-2.8
16.7	6.5

16.8	29.5
61.8	17.4
13.6	41.2
89.5	73.6

src1	src2
115.0	-
-	-

-	-
-	-
-	-

15.0	6.1
22.2	8.2
17.2	12.2
21.2	11.4

30.8	22.8
67.8	10.0
38.3	32.0
89.9	62.7

src1	src2
120.0	-
-	-

-	-
-	-
-	-

5.9	0.9
10.2	3.7
8.3	1.4
14.4	7.8

32.6	17.9
62.4	13.6
40.5	19.2
91.3	70.4

src1	src2
120.0	-
-	-

-	-
-	-
-	-

7.4	3.8
10.9	8.4
11.6	5.6
12.9	9.1

43.2	17.8
68.2	9.0
56.9	20.3
91.0	64.7

src1	src2
45.0	-
-	-

-	-
-	-
-	-

8.4	0.7
15.3	2.7
10.2	2.1
14.9	3.4

24.9	22.9
66.7	10.6
27.7	31.9
89.9	63.6

Algorithm 2
J. Even, H. Saruwatari & K. Shikano

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
125.0	-

4.7	-
Inf	-
4.7	-

-10.0	-19.0
-8.9	-17.5
16.2	6.2
8.6	11.0

36.2	42.4
28.1	5.6
58.8	57.8
61.4	78.8

src1	src2
120.0	-
125.0	-

5.6	-
Inf	-
5.6	-

-8.8	-23.8
-7.9	-19.7
20.5	-0.4
8.9	9.1

39.3	33.9
30.5	6.5
63.1	44.5
61.9	80.2

src1	src2
120.0	-
126.0	-

1.8	-
Inf	-
1.8	-

-9.4	-21.4
-7.7	-19.6
14.8	5.0
6.4	10.9

37.5	41.3
51.7	5.1
61.0	56.0
59.7	79.0

src1	src2
115.0	-
116.0	-

0.8	-
Inf	-
0.8	-

-2.9	-26.3
-1.2	-19.8
23.6	-4.5
7.8	12.8

24.3	25.6
37.0	7.4
41.1	32.3
54.6	74.3

src1	src2
115.0	-
116.0	-

2.5	-
Inf	-
2.5	-

-7.3	-20.5
-6.4	-17.5
21.3	1.4
9.6	14.9

28.9	18.6
24.4	8.9
54.4	19.8
46.7	71.5

src1	src2
120.0	-
124.0	-

4.3	-
Inf	-
4.3	-

-10.9	-23.2
-10.1	-21.2
19.3	4.0
9.2	11.2

36.0	33.7
28.6	7.2
59.6	47.9
59.0	72.7

src1	src2
120.0	-
125.0	-

4.2	-
Inf	-
4.2	-

-11.3	-24.3
-10.1	-22.5
16.4	4.1
7.9	13.4

39.6	25.8
65.6	7.8
64.8	31.5
57.3	77.9

src1	src2
45.0	-
54.0	-

2.7	-
Inf	-
2.7	-

-5.5	-23.6
-3.9	-20.5
22.0	0.8
6.8	14.1

30.5	34.4
31.5	6.6
53.4	47.1
54.8	76.7

Algorithm 3
Dang Hai Tran Vu

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
126.0	-

-0.3	-
Inf	-
-0.3	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
120.0	-
126.0	-

-0.4	-
Inf	-
-0.4	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
120.0	-
127.0	-

-0.5	-
Inf	-
-0.5	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
115.0	-
107.0	-

1.0	-
Inf	-
1.0	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
115.0	-
115.0	-

1.2	-
Inf	-
1.2	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
120.0	-
126.0	-

1.0	-
Inf	-
1.0	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
120.0	-
126.0	-

0.6	-
Inf	-
0.6	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
45.0	-
52.0	-

0.9	-
Inf	-
0.9	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

Algorithm 4
M. Go, H. Saruwatari, T. Inoue & K. Shikano

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
126.0	-

-17.5	-
Inf	-
-17.5	-

-10.2	-19.5
-9.0	-18.1
12.1	9.2
9.7	7.7

24.3	44.0
25.5	4.7
44.0	63.5
47.6	69.6

src1	src2
120.0	-
126.0	-

-18.2	-
Inf	-
-18.2	-

-10.5	-24.3
-9.8	-21.6
18.4	5.5
11.0	4.3

28.2	36.3
26.9	6.7
51.7	63.0
48.5	50.6

src1	src2
120.0	-
126.0	-

-18.8	-
Inf	-
-18.8	-

-10.8	-20.2
-9.0	-18.6
11.5	7.9
6.6	7.7

22.6	40.5
24.6	4.6
41.2	60.7
45.0	65.9

src1	src2
115.0	-
111.0	-

-22.4	-
Inf	-
-22.4	-

-9.7	-25.6
-9.3	-22.6
20.5	4.3
14.9	4.4

17.2	24.4
28.6	6.1
26.1	49.8
49.4	37.1

src1	src2
115.0	-
118.0	-

-14.3	-
Inf	-
-14.3	-

-7.6	-22.5
-6.7	-20.6
18.6	5.5
9.8	8.6

15.4	17.7
30.6	8.7
33.4	27.5
28.6	46.7

src1	src2
120.0	-
126.0	-

-17.4	-
Inf	-
-17.4	-

-11.7	-22.9
-10.9	-21.0
15.0	9.4
10.4	5.2

24.4	34.4
26.3	6.1
46.4	63.3
43.6	45.3

src1	src2
120.0	-
126.0	-

-20.5	-
Inf	-
-20.5	-

-11.4	-24.2
-10.0	-22.7
13.7	6.7
7.7	9.7

22.2	29.7
22.8	5.1
44.5	44.3
38.7	64.7

src1	src2
45.0	-
53.0	-

-22.4	-
Inf	-
-22.4	-

-10.4	-24.0
-9.9	-22.4
16.2	8.1
13.4	6.8

20.7	26.7
23.6	7.5
34.3	54.9
49.6	37.7

Algorithm 5
N. Hirata, H. Saruwatari, T. Inoue & K. Shikano

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
126.0	-

-12.9	-
Inf	-
-12.9	-

-6.4	-18.9
-3.7	-17.3
11.9	7.2
5.8	8.7

20.5	42.1
31.2	5.6
40.7	56.1
38.9	81.7


-	-
-	-

-	-
-	-
-	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
120.0	-
126.0	-

-17.3	-
Inf	-
-17.3	-

-9.0	-19.7
-6.5	-17.8
11.1	5.3
5.8	9.0

25.7	39.9
28.9	5.1
48.5	52.2
44.6	83.2


-	-
-	-

-	-
-	-
-	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
115.0	-
117.0	-

-8.7	-
Inf	-
-8.7	-

2.4	-19.3
6.9	-15.6
19.4	0.8
4.6	10.1

14.1	18.4
41.4	8.5
40.7	20.0
17.5	69.7


-	-
-	-

-	-
-	-
-	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
120.0	-
125.0	-

-16.3	-
Inf	-
-16.3	-

-11.6	-22.5
-9.7	-20.1
12.1	3.2
6.0	10.4

25.0	23.7
43.5	7.0
52.2	30.0
36.2	70.9


-	-
-	-

-	-
-	-
-	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

Algorithm 6
H. Sawada

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
-	-

-	-
-	-
-	-

6.8	3.8
16.1	5.8
8.6	9.6
12.8	6.5

37.0	46.5
71.3	8.5
51.2	67.6
84.1	69.5

src1	src2
120.0	-
-	-

-	-
-	-
-	-

10.3	2.1
16.9	4.3
12.5	4.3
16.7	5.8

40.0	36.8
71.4	11.7
55.6	56.3
84.3	67.3

src1	src2
120.0	-
-	-

-	-
-	-
-	-

6.9	3.3
15.6	5.8
9.3	7.9
11.7	4.8

43.5	45.5
72.7	8.3
59.8	67.1
85.5	67.9

src1	src2
115.0	-
-	-

-	-
-	-
-	-

12.1	0.7
17.1	4.3
16.2	-0.2
16.6	4.5

19.9	24.5
64.6	12.4
24.4	41.1
71.7	52.7

src1	src2
115.0	-
-	-

-	-
-	-
-	-

10.2	1.3
15.8	3.4
12.1	1.5
18.7	6.8

30.2	19.5
66.4	9.5
44.8	31.4
72.9	48.2

src1	src2
120.0	-
-	-

-	-
-	-
-	-

9.3	4.4
16.7	7.5
12.4	9.1
13.9	6.7

37.2	38.9
72.0	7.7
52.5	60.8
82.0	63.1

src1	src2
120.0	-
-	-

-	-
-	-
-	-

6.2	2.5
12.2	5.0
8.2	3.8
13.3	6.4

47.5	29.6
73.6	7.7
64.1	46.1
86.5	62.0

src1	src2
45.0	-
-	-

-	-
-	-
-	-

10.9	4.1
15.1	8.2
15.5	6.4
15.8	10.4

28.5	33.3
71.6	7.1
38.0	54.4
80.8	58.6

STFT
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2
13.3	10.6
26.5	20.1
22.7	23.2
13.9	10.7

src1	src2
17.4	9.3
32.0	17.8
25.9	23.3
18.2	9.3

src1	src2
12.5	8.9
28.0	16.2
19.7	23.7
13.3	8.9

src1	src2
20.4	8.3
36.3	15.4
27.6	23.6
21.5	8.3

src1	src2
21.3	12.5
31.5	19.8
28.7	22.8
22.7	13.6

src1	src2
15.3	10.4
27.2	19.0
24.1	22.1
16.1	10.7

src1	src2
14.6	11.1
29.3	18.4
21.9	25.8
15.6	11.6

src1	src2
18.2	10.6
30.8	18.9
26.6	22.9
19.1	10.9

Cochleagram
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2
11.1	3.0
23.3	4.6
17.9	16.0
12.1	3.4

src1	src2
14.8	3.3
26.9	5.3
20.6	13.5
16.4	3.0

src1	src2
10.2	2.4
25.2	3.9
15.3	15.8
11.7	1.5

src1	src2
18.0	3.0
31.2	4.8
22.7	14.1
20.0	2.5

src1	src2
19.5	1.5
29.4	2.2
24.6	11.8
21.7	1.7

src1	src2
13.0	3.3
22.8	5.0
19.9	13.3
14.5	4.0

src1	src2
12.7	1.2
26.3	1.8
18.1	13.1
14.2	0.3

src1	src2
15.6	3.3
26.2	4.8
21.5	14.6
17.4	4.4

Detailed Results for Cafeteria Noise, with 2 channels, 3 srcs

Return to top

Test 1 3src_Ca_Ce_A
mix

Test 2 3src_Ca_Ce_A
mix

Test 1 3src_Ca_Ce_B
mix

Test 2 3src_Ca_Ce_B
mix

Test 1 3src_Ca_Co_A
mix

Test 2 3src_Ca_Co_A
mix

Test 1 3src_Ca_Co_B
mix

Test 2 3src_Ca_Co_B
mix

Algorithm 1
N. Duong

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2	src3	src4
20.0	120.0	85.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

0.5	-0.4	3.2	1.7
5.0	2.6	7.0	2.8
-0.2	-3.8	4.7	3.8
8.2	5.3	9.5	5.2

11.5	6.4	23.9	23.7
45.8	7.2	47.2	42.5
9.3	4.0	31.3	33.8
65.4	43.1	74.1	66.5

src1	src2	src3	src4
120.0	150.0	45.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

2.9	10.8	-3.7	2.4
5.0	15.8	1.8	5.5
5.5	13.9	-12.1	3.3
7.2	16.4	4.6	6.3

8.8	22.1	4.7	19.6
36.9	53.7	11.7	43.8
5.4	26.8	2.2	25.0
64.0	76.6	41.3	66.5

src1	src2	src3	src4
120.0	45.0	85.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

1.3	-0.8	1.0	6.0
3.9	2.9	3.5	9.3
1.4	-4.2	1.2	9.7
5.2	6.1	6.2	10.4

9.2	6.5	22.9	16.9
30.1	10.2	45.9	49.0
7.6	3.5	30.7	18.3
51.0	50.3	70.0	70.1

src1	src2	src3	src4
120.0	45.0	85.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

-9.5	3.9	1.9	3.1
2.0	5.6	3.6	4.3
-17.0	8.4	2.5	8.9
7.1	10.7	6.5	7.8

5.0	23.4	12.0	19.4
20.5	50.2	38.2	43.4
1.9	31.2	12.0	24.8
54.3	72.1	55.5	65.8

src1	src2	src3	src4
120.0	20.0	85.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

3.2	2.2	6.6	-1.3
5.6	6.3	11.8	1.0
5.3	2.7	9.2	-10.2
7.8	7.1	10.7	2.8

27.1	13.2	27.3	4.2
49.7	45.5	50.1	5.7
38.7	13.0	37.8	1.7
71.9	62.4	74.7	39.3

src1	src2	src3	src4
20.0	115.0	85.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

-0.3	-2.6	5.7	2.3
5.5	3.2	9.2	3.2
-2.2	-6.7	9.1	8.0
8.2	5.2	10.0	5.8

19.0	7.6	28.4	8.2
56.7	8.2	54.6	38.7
22.7	5.9	40.3	5.4
70.3	41.7	74.3	57.8

src1	src2	src3	src4
85.0	120.0	45.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

-6.0	3.3	3.1	1.4
4.1	5.1	4.2	3.0
-9.3	7.0	9.3	1.7
7.8	9.9	8.1	5.9

4.2	22.5	19.6	15.1
13.6	48.0	42.8	39.2
1.4	29.7	25.7	17.9
50.2	71.0	64.5	58.3

src1	src2	src3	src4
115.0	45.0	85.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

2.1	-2.1	5.3	-2.4
2.7	5.8	8.9	2.0
9.8	-4.6	8.2	-9.3
6.5	9.0	10.4	3.3

12.4	15.9	18.4	8.0
43.1	53.1	50.0	12.3
11.3	17.8	21.8	7.1
63.1	65.2	68.8	40.3

Algorithm 3
Dang Hai Tran Vu

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2	src3	src4
20.0	120.0	85.0	-
30.0	126.0	90.0	-

4.6	-2.3	-0.8	-
13.5	0.8	2.9	-
5.4	3.3	3.5	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
120.0	150.0	45.0	-
89.0	127.0	52.0	-

6.2	1.1	-9.7	-
18.9	5.0	-7.6	-
6.4	4.6	2.7	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
120.0	45.0	85.0	-
125.0	51.0	89.0	-

-1.2	-2.3	2.5	-
3.2	1.1	10.5	-
2.4	2.9	3.7	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
120.0	45.0	85.0	-
125.0	52.0	86.0	-

-1.9	3.6	-6.5	-
0.8	11.4	-4.2	-
4.0	4.7	3.0	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
120.0	20.0	85.0	-
125.0	26.0	91.0	-

-3.2	4.0	-3.8	-
0.0	12.1	-0.7	-
2.6	5.1	2.5	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
20.0	115.0	85.0	-
28.0	148.0	102.0	-

3.9	-8.1	-1.1	-
11.5	-5.8	4.5	-
5.0	2.5	1.6	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
85.0	120.0	45.0	-
53.0	89.0	124.0	-

-2.5	4.4	-6.1	-
1.8	12.2	-3.2	-
1.8	5.5	1.8	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
115.0	45.0	85.0	-
100.0	87.0	49.0	-

2.8	-7.7	-2.0	-
12.6	-4.4	3.1	-
3.5	0.8	1.3	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

STFT
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2	src3	src4
8.3	7.8	10.0	7.8
18.2	17.8	19.4	13.0
16.9	17.1	21.9	22.3
8.7	7.9	10.3	8.4

src1	src2	src3	src4
9.0	9.7	12.7	4.1
18.9	18.9	24.8	7.5
18.4	21.4	22.9	19.0
9.2	9.9	13.2	3.6

src1	src2	src3	src4
8.5	11.1	10.1	8.3
17.2	22.9	19.5	14.0
18.7	20.5	21.5	22.1
8.8	11.5	10.3	8.8

src1	src2	src3	src4
9.6	12.8	9.9	4.0
19.0	24.3	20.6	7.4
22.9	23.1	18.6	17.5
9.7	13.4	10.3	3.4

src1	src2	src3	src4
8.6	8.8	10.7	7.0
18.1	18.9	20.2	11.4
18.2	17.4	22.6	20.2
8.8	9.2	10.9	7.8

src1	src2	src3	src4
8.2	12.1	8.6	6.3
17.0	23.7	18.1	10.1
17.9	22.7	18.2	21.2
8.4	12.6	8.8	7.0

src1	src2	src3	src4
9.9	9.4	12.7	7.2
20.2	18.9	23.3	11.3
19.7	21.8	23.1	18.3
10.2	9.5	13.3	8.6

src1	src2	src3	src4
13.2	11.2	9.2	7.0
23.9	21.8	18.2	11.6
23.4	21.9	19.2	21.5
13.8	11.7	9.5	7.7

Cochleagram
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2	src3	src4
6.2	5.5	7.4	1.2
13.0	12.4	14.7	1.8
15.5	13.4	17.7	12.7
6.3	5.2	7.5	-1.6

src1	src2	src3	src4
6.8	7.3	10.5	1.1
13.8	14.2	20.3	1.9
15.4	17.2	19.6	11.4
6.7	7.3	11.1	-2.3

src1	src2	src3	src4
6.3	8.5	7.5	1.3
12.2	17.5	14.1	2.0
16.4	16.1	17.8	11.9
6.4	9.0	7.6	-1.3

src1	src2	src3	src4
7.2	10.8	7.6	1.0
14.0	20.2	15.6	1.8
18.5	20.0	15.6	9.8
7.1	11.5	7.8	-3.0

src1	src2	src3	src4
6.1	6.6	7.9	1.0
13.1	13.7	15.8	1.5
15.0	15.8	18.4	9.2
5.9	6.7	8.1	-1.8

src1	src2	src3	src4
6.0	9.3	6.2	1.4
12.1	18.4	13.5	2.0
16.3	18.2	14.7	12.7
5.9	9.8	6.0	0.1

src1	src2	src3	src4
7.6	7.0	10.8	1.2
15.4	14.0	20.0	1.7
16.4	18.3	20.0	8.4
7.7	7.0	11.5	-0.5

src1	src2	src3	src4
10.6	8.4	6.7	1.6
19.6	17.2	13.2	2.4
20.0	17.3	16.1	10.7
11.1	8.8	6.9	0.6

Detailed Results for Square, with 2 channels, 1 src

Return to top

Test1 1src_Sq_Ce_A
mix

Test2 1src_Sq_Ce_A
mix

Test1 1src_Sq_Ce_B
mix

Test2 1src_Sq_Ce_B
mix

Test1 1src_Sq_Co_A
mix

Test2 1src_Sq_Co_A
mix

Test1 1src_Sq_Co_B
mix

Test2 1src_Sq_Co_B
mix

Algorithm 1
N. Duong

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
-	-

-	-
-	-
-	-

-2.2	10.7
17.7	13.5
0.5	31.7
3.0	13.0

40.2	77.1
76.4	2.6
54.9	84.0
86.6	79.7

src1	src2
120.0	-
-	-

-	-
-	-
-	-

2.4	3.4
13.6	4.5
3.2	10.4
10.4	5.7

41.0	63.8
79.4	8.7
53.5	81.1
92.6	69.9

src1	src2
85.0	-
-	-

-	-
-	-
-	-

-8.5	5.4
11.5	6.5
-7.2	29.0
5.6	8.3

31.4	76.8
77.9	3.1
41.0	83.6
86.6	81.5

src1	src2
120.0	-
-	-

-	-
-	-
-	-

3.8	3.4
29.1	4.0
4.4	26.6
13.1	5.9

55.6	66.9
80.0	8.3
70.1	83.8
91.9	65.7

src1	src2
20.0	-
-	-

-	-
-	-
-	-

7.0	3.5
14.8	5.8
9.2	8.0
12.2	5.7

61.8	18.6
77.5	4.9
75.1	23.6
91.7	59.1

src1	src2
20.0	-
-	-

-	-
-	-
-	-

-0.4	1.0
10.3	1.9
-0.5	2.1
10.9	2.5

56.9	9.5
71.5	11.6
72.4	5.5
88.3	69.3

src1	src2
115.0	-
-	-

-	-
-	-
-	-

9.3	6.0
21.2	7.9
11.4	17.5
14.0	8.5

45.0	51.7
79.3	4.7
58.9	71.2
92.2	71.7

src1	src2
120.0	-
-	-

-	-
-	-
-	-

7.7	8.9
29.9	10.3
9.4	31.1
12.9	12.6

63.0	70.9
79.7	4.2
76.2	84.4
90.7	68.8

Algorithm 2
J. Even, H. Saruwatari & K. Shikano

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
126.0	-

8.0	-
Inf	-
8.0	-

-9.6	-5.3
-7.7	-5.1
11.3	19.8
6.1	23.1

32.2	87.2
36.8	4.4
55.3	86.6
56.5	85.6

src1	src2
120.0	-
125.0	-

7.0	-
Inf	-
7.0	-

-11.0	-17.3
-9.1	-15.5
10.8	4.9
6.5	12.0

35.4	86.8
45.6	6.0
61.3	86.2
53.8	87.5

src1	src2
85.0	-
91.0	-

6.2	-
Inf	-
6.2	-

-11.2	-4.3
-8.9	-4.2
10.7	20.8
5.1	22.2

25.0	92.8
27.3	6.6
44.9	88.2
48.9	86.8

src1	src2
120.0	-
125.0	-

6.6	-
Inf	-
6.6	-

-10.8	-17.2
-8.6	-14.9
8.9	3.1
6.5	12.1

46.4	80.3
100.0	6.1
72.2	84.0
59.0	87.1

src1	src2
20.0	-
23.0	-

9.2	-
Inf	-
9.2	-

-7.2	-20.9
-5.9	-19.6
23.9	5.9
8.1	15.1

46.9	75.9
100.0	5.4
75.4	82.1
53.3	87.8

src1	src2
20.0	-
23.0	-

12.0	-
Inf	-
12.0	-

-8.3	-19.7
-7.6	-19.7
26.4	31.4
11.0	22.0

53.3	86.2
100.0	6.3
77.9	85.8
61.0	88.2

src1	src2
115.0	-
119.0	-

12.1	-
Inf	-
12.1	-

-12.8	-20.6
-12.3	-20.4
27.1	17.7
11.1	15.7

40.0	91.7
95.1	3.9
68.3	88.4
52.6	83.0

src1	src2
120.0	-
125.0	-

11.2	-
Inf	-
11.2	-

-9.4	-20.3
-8.5	-20.0
22.4	13.6
8.9	18.3

53.1	87.2
100.0	4.6
77.5	86.5
61.0	86.8

Algorithm 3
Dang Hai Tran Vu

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
125.0	-

4.5	-
Inf	-
4.5	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
120.0	-
125.0	-

9.8	-
Inf	-
9.8	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
85.0	-
91.0	-

4.2	-
Inf	-
4.2	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
120.0	-
125.0	-

8.5	-
Inf	-
8.5	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
20.0	-
23.0	-

8.5	-
Inf	-
8.5	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
20.0	-
23.0	-

12.7	-
Inf	-
12.7	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
115.0	-
119.0	-

12.7	-
Inf	-
12.7	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
120.0	-
125.0	-

8.9	-
Inf	-
8.9	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

Algorithm 4
M. Go, H. Saruwatari, T. Inoue & K. Shikano

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
126.0	-

-27.4	-
Inf	-
-27.4	-

-19.5	-3.6
-2.7	-1.5
-11.6	29.7
8.2	6.9

9.1	76.6
37.7	5.4
10.2	86.1
38.4	72.4

src1	src2
120.0	-
126.0	-

-16.5	-
Inf	-
-16.5	-

-13.6	-14.6
-9.7	-12.3
2.4	9.6
7.4	4.4

20.2	73.2
24.0	12.1
36.9	85.3
42.4	67.6

src1	src2
85.0	-
92.0	-

-26.6	-
Inf	-
-26.6	-

-20.7	-3.6
-3.3	-1.3
-12.5	23.5
8.0	6.4

9.2	87.9
38.8	6.3
10.0	87.9
39.8	81.4

src1	src2
120.0	-
126.0	-

-18.3	-
Inf	-
-18.3	-

-11.2	-14.5
-6.5	-11.8
2.5	5.8
6.2	5.5

25.3	68.2
42.2	10.2
49.8	83.3
42.0	67.0

src1	src2
20.0	-
23.0	-

-17.4	-
Inf	-
-17.4	-

-9.0	-19.3
-6.8	-17.6
11.7	5.9
6.0	10.5

26.2	26.0
49.0	8.6
53.2	51.9
39.9	40.2

src1	src2
20.0	-
23.0	-

-14.1	-
Inf	-
-14.1	-

-10.5	-17.7
-9.4	-17.2
12.8	14.6
9.9	12.2

37.7	34.5
83.8	6.1
68.0	65.3
47.4	42.7

src1	src2
115.0	-
120.0	-

-11.4	-
Inf	-
-11.4	-

-12.2	-19.7
-11.4	-19.4
14.7	17.4
10.4	14.4

20.1	90.8
26.5	4.3
39.9	88.1
37.7	82.1

src1	src2
120.0	-
126.0	-

-17.5	-
Inf	-
-17.5	-

-11.4	-20.1
-9.2	-19.9
10.4	27.5
6.2	13.6

25.8	70.2
72.7	4.3
52.4	83.6
39.1	69.5

Algorithm 5
N. Hirata, H. Saruwatari, T. Inoue & K. Shikano

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
125.0	-

-9.1	-
Inf	-
-9.1	-

-11.6	-5.4
-6.8	-5.2
2.8	27.3
4.7	18.4

18.8	83.3
31.7	4.4
36.3	85.4
38.0	84.7


-	-
-	-

-	-
-	-
-	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
85.0	-
91.0	-

-11.2	-
Inf	-
-11.2	-

-13.0	-4.7
-6.5	-4.6
2.3	21.6
1.2	20.7

11.2	90.6
32.6	6.6
28.2	88.6
18.0	81.6


-	-
-	-

-	-
-	-
-	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
20.0	-
22.0	-

-5.9	-
Inf	-
-5.9	-

-3.7	-20.0
0.5	-18.4
17.3	5.6
3.3	10.9

25.1	39.1
42.7	6.9
60.1	59.0
28.7	68.2


-	-
-	-

-	-
-	-
-	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

src1	src2
115.0	-
119.0	-

-1.9	-
Inf	-
-1.9	-

-6.5	-19.8
-3.9	-19.5
22.2	17.4
5.0	15.6

18.1	93.4
36.3	4.0
47.6	88.5
22.6	84.5


-	-
-	-

-	-
-	-
-	-

-	-
-	-
-	-
-	-

-	-
-	-
-	-
-	-

Algorithm 6
H. Sawada

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2
120.0	-
-	-

-	-
-	-
-	-

-13.2	0.3
11.1	0.3
-13.2	33.9
20.3	9.1

33.5	72.2
73.6	4.2
45.7	84.7
83.9	69.5

src1	src2
120.0	-
-	-

-	-
-	-
-	-

0.3	1.8
21.2	2.2
0.8	22.6
12.7	4.2

42.5	90.0
80.6	7.9
56.1	88.1
91.1	83.8

src1	src2
85.0	-
-	-

-	-
-	-
-	-

-1.6	12.4
7.8	15.9
0.5	21.5
3.7	15.6

35.1	86.4
79.4	6.4
46.9	87.5
87.1	80.9

src1	src2
120.0	-
-	-

-	-
-	-
-	-

1.1	1.4
9.7	2.5
1.2	5.4
12.0	7.8

55.3	81.3
78.3	7.6
70.6	85.7
89.7	82.1

src1	src2
20.0	-
-	-

-	-
-	-
-	-

4.2	1.1
27.3	1.6
4.7	24.3
13.9	2.1

62.8	81.5
78.5	5.4
76.5	86.4
89.5	78.1

src1	src2
20.0	-
-	-

-	-
-	-
-	-

-1.0	0.5
23.5	0.8
-0.7	27.7
14.1	3.0

61.7	82.1
77.5	7.7
76.0	86.7
88.3	78.5

src1	src2
115.0	-
-	-

-	-
-	-
-	-

10.4	7.3
21.4	8.7
11.6	17.4
18.1	13.2

46.3	89.4
80.3	5.0
61.7	88.0
89.3	82.3

src1	src2
120.0	-
-	-

-	-
-	-
-	-

6.0	7.8
21.6	9.9
8.1	24.0
10.4	11.4

61.7	83.1
79.4	5.1
76.1	86.9
88.3	78.3

STFT
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2
9.6	23.1
15.5	35.6
22.1	29.1
10.5	24.6

src1	src2
13.0	14.6
22.7	22.6
21.2	24.4
14.1	15.6

src1	src2
9.2	23.4
17.0	37.9
23.2	31.3
9.4	24.4

src1	src2
14.8	15.0
30.0	21.8
21.5	30.6
15.8	15.9

src1	src2
16.8	13.6
35.8	20.3
23.5	32.2
17.9	14.4

src1	src2
18.8	20.4
34.3	28.7
27.1	36.1
19.6	21.2

src1	src2
18.3	15.4
24.9	25.1
28.1	22.0
19.9	16.9

src1	src2
16.2	17.9
33.0	24.3
22.5	35.0
17.3	19.0

Cochleagram
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2
7.6	3.9
11.8	4.5
19.2	20.3
9.2	7.3

src1	src2
10.9	0.7
20.0	0.9
17.6	12.8
12.3	-0.1

src1	src2
6.6	3.9
10.1	4.5
21.2	18.5
8.1	7.2

src1	src2
12.5	0.7
26.1	0.9
17.9	13.9
14.0	-0.2

src1	src2
14.9	1.8
29.4	2.3
21.3	16.9
16.1	1.6

src1	src2
16.4	1.0
29.7	1.1
22.5	15.5
17.9	0.9

src1	src2
16.5	2.1
21.6	2.7
24.4	17.7
19.2	1.9

src1	src2
13.7	0.9
27.5	1.0
18.9	14.1
15.4	-0.1

Detailed Results for Square, with 2 channels, 3 srcs

Return to top

Test1 3src_Sq_Ce_A
mix

Test2 3src_Sq_Ce_A
mix

Test1 3src_Sq_Ce_B
mix

Test2 3src_Sq_Ce_B
mix

Test1 3src_Sq_Co_A
mix

Test2 3src_Sq_Co_A
mix

Test1 3src_Sq_Co_B
mix

Test2 3src_Sq_Co_B
mix

Algorithm 1
N. Duong

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2	src3	src4
150.0	120.0	45.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

3.4	0.9	0.3	-0.1
13.0	1.3	3.5	13.3
4.4	4.3	0.5	0.2
10.1	1.6	3.5	9.2

22.6	7.4	24.3	16.9
61.7	6.8	41.4	63.0
29.0	5.5	38.4	17.1
73.8	42.6	59.5	75.3

src1	src2	src3	src4
85.0	20.0	115.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

3.0	3.7	6.7	0.2
7.4	9.7	13.8	1.6
5.2	5.7	10.2	-4.0
8.3	6.8	9.3	4.6

41.3	39.3	24.0	3.4
67.9	59.0	60.0	7.2
58.7	60.8	33.3	1.0
81.0	69.7	70.3	44.2

src1	src2	src3	src4
20.0	115.0	150.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

-0.4	1.0	1.2	0.9
14.6	12.4	3.1	1.3
-0.4	1.4	2.4	7.2
9.4	9.9	4.1	2.1

41.6	19.9	10.8	8.0
71.3	56.4	33.6	5.3
58.1	24.8	10.3	7.0
83.4	69.8	52.7	39.4

src1	src2	src3	src4
85.0	20.0	115.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

6.5	4.3	1.0	0.2
12.3	7.9	8.0	1.2
9.6	7.0	0.7	-5.1
9.8	8.5	6.7	1.9

47.7	30.5	29.8	4.7
66.1	67.6	53.6	10.6
67.1	46.8	47.5	1.9
79.4	69.9	64.8	47.1

src1	src2	src3	src4
115.0	20.0	85.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

4.2	3.4	5.4	0.1
9.8	10.8	9.5	1.2
5.8	4.5	8.8	-2.1
11.3	7.2	9.2	5.0

48.4	34.3	19.1	5.3
71.5	66.4	50.5	2.9
66.8	52.2	23.5	3.2
82.1	72.3	68.2	33.0

src1	src2	src3	src4
20.0	150.0	120.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

2.2	6.4	10.3	6.3
5.9	17.0	13.0	8.3
4.4	7.8	19.1	15.5
4.7	12.0	14.0	8.7

23.6	22.0	41.2	4.9
53.8	60.7	62.2	6.7
34.0	29.9	60.2	2.6
66.7	68.5	76.9	37.4

src1	src2	src3	src4
120.0	85.0	20.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

0.2	4.9	3.8	4.4
1.7	9.9	9.7	10.6
-2.3	7.9	6.5	5.8
2.8	8.7	5.5	9.0

4.3	21.4	28.0	40.5
8.6	42.9	63.7	69.0
1.5	29.6	42.8	58.4
48.4	64.6	68.3	79.5

src1	src2	src3	src4
120.0	20.0	150.0	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-

2.9	5.7	8.1	1.1
18.0	7.3	15.2	2.3
3.3	14.8	12.0	3.1
13.5	7.7	11.0	3.2

24.6	4.2	38.6	30.6
65.3	5.1	64.4	52.7
33.9	1.8	56.4	48.6
72.5	37.3	77.7	65.5

Algorithm 3
Dang Hai Tran Vu

True_DOA (Deg)
Est_DOA (Deg)

SDR (dB)
SIR (dB)
SAR (dB)

SDRi (dB)
ISRi (dB)
SIRi (dB)
SARi (dB)

OPSi
TPSi
IPSi
APSi

src1	src2	src3	src4
150.0	120.0	45.0	-
152.0	125.0	46.0	-

-5.5	4.1	8.6	-
-4.2	6.9	14.7	-
6.2	8.2	10.0	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
85.0	20.0	115.0	-
91.0	22.0	121.0	-

-2.3	4.6	8.5	-
-1.2	7.2	15.1	-
7.5	8.9	9.8	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
20.0	115.0	150.0	-
24.0	119.0	154.0	-

2.2	-0.8	6.7	-
3.9	0.6	18.8	-
8.5	7.4	7.0	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
85.0	20.0	115.0	-
93.0	50.0	120.0	-

-1.5	5.5	5.9	-
-0.0	7.9	11.1	-
7.1	9.8	7.8	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
115.0	20.0	85.0	-
20.0	92.0	120.0	-

-2.5	4.7	6.7	-
-1.3	7.3	15.2	-
7.2	8.9	7.4	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
20.0	150.0	120.0	-
22.0	150.0	122.0	-

11.7	4.7	-4.0	-
20.3	6.4	-3.1	-
12.3	10.3	7.9	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
120.0	85.0	20.0	-
125.0	92.0	21.0	-

4.0	-2.3	6.3	-
6.4	-0.9	12.6	-
8.5	6.7	7.7	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

src1	src2	src3	src4
120.0	20.0	150.0	-
151.0	125.0	23.0	-

9.8	2.9	-2.3	-
20.1	5.2	-0.7	-
10.3	7.9	6.2	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

-	-	-	-
-	-	-	-
-	-	-	-
-	-	-	-

STFT
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2	src3	src4
11.4	9.5	11.3	14.3
20.2	17.9	24.1	22.3
24.2	23.1	21.9	23.1
11.9	9.7	11.6	15.5

src1	src2	src3	src4
10.6	10.2	11.8	11.8
21.1	19.8	25.9	18.2
24.0	20.9	22.2	23.3
10.8	10.5	12.0	12.9

src1	src2	src3	src4
8.5	9.6	10.4	12.8
19.2	20.2	19.5	20.3
18.9	21.1	23.1	23.0
8.4	9.7	10.7	13.9

src1	src2	src3	src4
10.6	10.5	11.7	11.8
22.2	22.9	22.6	17.6
24.4	20.4	23.9	22.7
10.6	10.7	12.0	13.2

src1	src2	src3	src4
10.3	9.9	10.0	12.2
21.4	22.0	21.0	17.4
21.8	19.9	23.1	27.6
10.3	10.1	10.1	13.5

src1	src2	src3	src4
12.1	12.7	9.7	13.7
22.8	20.9	19.4	19.8
24.5	25.1	19.6	21.1
12.4	13.4	10.1	15.9

src1	src2	src3	src4
10.2	8.0	9.8	11.2
20.6	16.1	21.8	17.1
24.0	18.9	18.7	21.8
10.2	8.1	10.2	12.4

src1	src2	src3	src4
8.7	8.9	11.6	12.8
18.5	17.8	20.5	17.8
18.2	18.0	23.7	20.7
8.9	9.2	12.1	15.4

Cochleagram
Ideal Binary Mask

SDR (dB)
ISR (dB)
SIR (dB)
SAR (dB)

src1	src2	src3	src4
9.1	7.1	8.7	2.0
17.1	12.7	18.6	2.6
20.7	20.0	17.5	15.0
9.3	7.3	8.9	2.1

src1	src2	src3	src4
8.0	7.5	8.9	0.7
14.8	14.1	19.3	1.0
20.5	17.7	16.9	12.8
8.1	7.7	9.2	-1.1

src1	src2	src3	src4
6.2	7.1	8.3	1.8
13.4	14.3	15.9	2.4
15.3	16.8	19.6	11.7
5.9	7.0	8.5	1.7

src1	src2	src3	src4
7.9	8.0	9.5	0.7
15.1	17.7	17.8	1.0
20.5	15.8	20.4	11.1
7.8	8.1	9.9	-1.0

src1	src2	src3	src4
7.7	7.4	7.3	1.6
15.9	16.4	13.6	2.0
16.8	15.8	19.2	16.0
7.7	7.3	7.3	3.1

src1	src2	src3	src4
9.6	10.4	7.3	0.8
18.3	18.0	14.6	0.9
20.8	21.4	16.8	9.6
9.8	11.0	7.3	-1.3

src1	src2	src3	src4
7.5	5.8	7.5	1.5
14.6	12.0	16.8	1.8
20.2	16.1	15.1	16.3
7.4	5.5	7.7	2.5

src1	src2	src3	src4
6.5	6.6	9.3	0.7
14.1	13.5	17.0	0.8
15.2	15.5	20.3	9.7
6.4	6.7	9.8	-1.5