TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Reshape Dimensions Network for Speaker Recognition

Reshape Dimensions Network for Speaker Recognition

Ivan Yakovlev, Rostislav Makarov, Andrei Balykin, Pavel Malov, Anton Okhotnikov, Nikita Torgashov

2024-07-25Speaker Recognition
PaperPDFCode(official)

Abstract

In this paper, we present Reshape Dimensions Network (ReDimNet), a novel neural network architecture for extracting utterance-level speaker representations. Our approach leverages dimensionality reshaping of 2D feature maps to 1D signal representation and vice versa, enabling the joint usage of 1D and 2D blocks. We propose an original network topology that preserves the volume of channel-timestep-frequency outputs of 1D and 2D blocks, facilitating efficient residual feature maps aggregation. Moreover, ReDimNet is efficiently scalable, and we introduce a range of model sizes, varying from 1 to 15 M parameters and from 0.5 to 20 GMACs. Our experimental results demonstrate that ReDimNet achieves state-of-the-art performance in speaker recognition while reducing computational complexity and the number of model parameters.

Results

TaskDatasetMetricValueModel
Speaker VerificationVoxCelebEER0.37ReDimNet-B6-SF2-LM-ASNorm (15.0M)
Speaker VerificationVoxCelebEER0.39ReDimNet-B5-SF2-LM-ASNorm (9.2M)
Speaker VerificationVoxCelebEER0.4ReDimNet-B6-SF2-LM (15.0M)
Speaker VerificationVoxCelebEER0.43ReDimNet-B5-SF2-LM (9.2M)
Speaker VerificationVoxCelebEER0.44ReDimNet-B4-LM-ASNorm (6.3M)
Speaker VerificationVoxCelebEER0.47ReDimNet-B3-LM-ASNorm (3.0M)
Speaker VerificationVoxCelebEER0.5ReDimNet-B3-LM (3.0M)
Speaker VerificationVoxCelebEER0.51ReDimNet-B4-LM (6.3M)
Speaker VerificationVoxCelebEER0.52ReDimNet-B2-SF2-LM-ASNorm (4.7M)
Speaker VerificationVoxCelebEER0.57ReDimNet-B2-SF2-LM (4.7M)
Speaker VerificationVoxCelebEER0.73ReDimNet-B1-LM-ASNorm (2.2M)
Speaker VerificationVoxCelebEER0.85ReDimNet-B1-LM (2.2M)
Speaker VerificationVoxCelebEER1.07ReDimNet-B0-LM-ASNorm (1.0M)
Speaker VerificationVoxCelebEER1.16ReDimNet-B0-LM (1.0M)
Speaker VerificationVoxCeleb1EER0.37ReDimNet-B6-SF2-LM-ASNorm (15.0M)
Speaker VerificationVoxCeleb1EER0.39ReDimNet-B5-SF2-LM-ASNorm (9.2M)
Speaker VerificationVoxCeleb1EER0.4ReDimNet-B6-SF2-LM (15.0M)
Speaker VerificationVoxCeleb1EER0.43ReDimNet-B5-SF2-LM (9.2M)
Speaker VerificationVoxCeleb1EER0.44ReDimNet-B4-LM-ASNorm (6.3M)
Speaker VerificationVoxCeleb1EER0.47ReDimNet-B3-LM-ASNorm (3.0M)
Speaker VerificationVoxCeleb1EER0.5ReDimNet-B3-LM (3.0M)
Speaker VerificationVoxCeleb1EER0.51ReDimNet-B4-LM (6.3M)
Speaker VerificationVoxCeleb1EER0.52ReDimNet-B2-SF2-LM-ASNorm (4.7M)
Speaker VerificationVoxCeleb1EER0.57ReDimNet-B2-SF2-LM (4.7M)
Speaker VerificationVoxCeleb1EER0.73ReDimNet-B1-LM-ASNorm (2.2M)
Speaker VerificationVoxCeleb1EER0.85ReDimNet-B1-LM (2.2M)
Speaker VerificationVoxCeleb1EER1.07ReDimNet-B0-LM-ASNorm (1.0M)
Speaker VerificationVoxCeleb1EER1.16ReDimNet-B0-LM (1.0M)

Related Papers

An Exploration of ECAPA-TDNN and x-vector Speaker Representations in Zero-shot Multi-speaker TTS2025-06-25A Comparative Evaluation of Deep Learning Models for Speech Enhancement in Real-World Noisy Environments2025-06-17CoLMbo: Speaker Language Model for Descriptive Profiling2025-06-11Learning Speaker-Invariant Visual Features for Lipreading2025-06-09Rhythm Features for Speaker Identification2025-06-07Synthetic Speech Source Tracing using Metric Learning2025-06-03LASPA: Language Agnostic Speaker Disentanglement with Prefix-Tuned Cross-Attention2025-06-02Investigating the Reasonable Effectiveness of Speaker Pre-Trained Models and their Synergistic Power for SingMOS Prediction2025-06-02