TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/KUIELab-MDX-Net: A Two-Stream Neural Network for Music Dem...

KUIELab-MDX-Net: A Two-Stream Neural Network for Music Demixing

Minseok Kim, Woosung Choi, Jaehwa Chung, Daewon Lee, Soonyoung Jung

2021-11-24Vocal Bursts Valence PredictionMusic Source Separation
PaperPDFCode(official)

Abstract

Recently, many methods based on deep learning have been proposed for music source separation. Some state-of-the-art methods have shown that stacking many layers with many skip connections improve the SDR performance. Although such a deep and complex architecture shows outstanding performance, it usually requires numerous computing resources and time for training and evaluation. This paper proposes a two-stream neural network for music demixing, called KUIELab-MDX-Net, which shows a good balance of performance and required resources. The proposed model has a time-frequency branch and a time-domain branch, where each branch separates stems, respectively. It blends results from two streams to generate the final estimation. KUIELab-MDX-Net took second place on leaderboard A and third place on leaderboard B in the Music Demixing Challenge at ISMIR 2021. This paper also summarizes experimental results on another benchmark, MUSDB18. Our source code is available online.

Results

TaskDatasetMetricValueModel
Music Source SeparationMUSDB18SDR (avg)7.54KUIELab-MDX-Net
Music Source SeparationMUSDB18SDR (bass)7.86KUIELab-MDX-Net
Music Source SeparationMUSDB18SDR (drums)7.33KUIELab-MDX-Net
Music Source SeparationMUSDB18SDR (other)5.95KUIELab-MDX-Net
Music Source SeparationMUSDB18SDR (vocals)9KUIELab-MDX-Net
Music Source SeparationMUSDB18-HQSDR (avg)7.47KUIELab-MDX-Net
Music Source SeparationMUSDB18-HQSDR (bass)7.83KUIELab-MDX-Net
Music Source SeparationMUSDB18-HQSDR (drums)7.2KUIELab-MDX-Net
Music Source SeparationMUSDB18-HQSDR (others)5.9KUIELab-MDX-Net
Music Source SeparationMUSDB18-HQSDR (vocals)8.97KUIELab-MDX-Net
2D ClassificationMUSDB18SDR (avg)7.54KUIELab-MDX-Net
2D ClassificationMUSDB18SDR (bass)7.86KUIELab-MDX-Net
2D ClassificationMUSDB18SDR (drums)7.33KUIELab-MDX-Net
2D ClassificationMUSDB18SDR (other)5.95KUIELab-MDX-Net
2D ClassificationMUSDB18SDR (vocals)9KUIELab-MDX-Net
2D ClassificationMUSDB18-HQSDR (avg)7.47KUIELab-MDX-Net
2D ClassificationMUSDB18-HQSDR (bass)7.83KUIELab-MDX-Net
2D ClassificationMUSDB18-HQSDR (drums)7.2KUIELab-MDX-Net
2D ClassificationMUSDB18-HQSDR (others)5.9KUIELab-MDX-Net
2D ClassificationMUSDB18-HQSDR (vocals)8.97KUIELab-MDX-Net

Related Papers

Music Source Restoration2025-05-27Training-Free Multi-Step Audio Source Separation2025-05-26Is MixIT Really Unsuitable for Correlated Sources? Exploring MixIT for Unsupervised Pre-training in Music Source Separation2025-05-12Solving Copyright Infringement on Short Video Platforms: Novel Datasets and an Audio Restoration Deep Learning Pipeline2025-04-30Score-informed Music Source Separation: Improving Synthetic-to-real Generalization in Classical Music2025-03-10Separate This, and All of these Things Around It: Music Source Separation via Hyperellipsoidal Queries2025-01-27Sanidha: A Studio Quality Multi-Modal Dataset for Carnatic Music2025-01-12MAJL: A Model-Agnostic Joint Learning Framework for Music Source Separation and Pitch Estimation2025-01-07