Schrödinger Bridge Mamba for One-Step Speech Enhancement

Abstract

We present Schrödinger Bridge Mamba (SBM), a novel model for efficient speech enhancement by integrating the Schrödinger Bridge (SB) training paradigm and the Mamba architecture. Experiments of joint denoising and dereverberation tasks demonstrate SBM outperforms strong generative and discriminative methods on multiple metrics with only one step of inference while achieving a competitive real-time factor for streaming feasibility. Ablation studies reveal that the SB paradigm consistently yields improved performance across diverse architectures over conventional mapping. Furthermore, Mamba exhibits a stronger performance under the SB paradigm compared to Multi-Head Self-Attention (MHSA) and Long Short-Term Memory (LSTM) backbones. These findings highlight the synergy between the Mamba architecture and the SB trajectory-based training, providing a high-quality solution for real-world speech enhancement.

DNS Real Recordings

Group 1
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 2
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 3
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 4
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 5
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 6
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 7
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 8
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J

DNS With Reverb

Group 1
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 2
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 3
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 4
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 5
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 6
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 7
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 8
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J

DNS No Reverb

Group 1
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 2
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 3
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 4
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 5
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 6
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 7
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 8
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J

VoiceBank-Demand

Group 1
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 2
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 3
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 4
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 5
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 6
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 7
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J
Group 8
Input
Spectrogram A
SBM
Spectrogram B
SB-NCSN++(50)
Spectrogram C
SB-NCSN++(10)
Spectrogram D
SB-NCSN++(1)
Spectrogram E
SBCTM
Spectrogram F
SB-UFOGen
Spectrogram G
ZipEnhancer
Spectrogram H
Mamba-base
Spectrogram I
FM-Mamba
Spectrogram J