TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Datasets/VibraVox (temple vibration pickup)

VibraVox (temple vibration pickup)

AudioSpeechTextsCC-by-4.0Introduced 2024-07-16

This is the temple vibration pickup variant of the VibraVox dataset.

VibraVox aims at serving as a valuable resource for advancing the field of body-conducted speech analysis and facilitating the development of robust communication systems for real-world applications. This dataset, available on HuggingFace can be used for various audio machine learning tasks :

  • Automatic Speech Recognition (ASR) (Speech-to-Text , Speech-to-Phoneme)
  • Audio Bandwidth Extension (BWE)
  • Speaker Verification (SPKV) / identification
  • Voice cloning
  • etc ...

The VibraVox dataset speech corpus has been released in July 2024. It includes french speech recorded simultaneously using multiple audio and vibration sensors : a forehead miniature vibration sensor, an in-ear comply foam-embedded microphone, an in-ear rigid earpiece-embedded microphone, a temple vibration pickup, a headset microphone located near the mouth, and a laryngophone. VibraVox has been recorded with 200 participants under various acoustic conditions imposed by a 5th order ambisonics spatialization sphere.

Benchmarks

Automatic Speech Recognition (ASR)/Test PERSpeaker Verification/Test EERSpeaker Verification/Test min-DCFSpeech Enhancement/Noresqua-MOSSpeech Enhancement/STOISpeech Enhancement/PER (wav2vec2)Speech Enhancement/EER (ECAPA2)Speech Recognition/Test PER

Related Benchmarks

VibraVox (forehead accelerometer)/Automatic Speech Recognition (ASR)/Test PERVibraVox (forehead accelerometer)/Speaker Verification/Test EERVibraVox (forehead accelerometer)/Speaker Verification/Test min-DCFVibraVox (forehead accelerometer)/Speech Enhancement/EER (ECAPA2)VibraVox (forehead accelerometer)/Speech Enhancement/Noresqua-MOSVibraVox (forehead accelerometer)/Speech Enhancement/PER (wav2vec2)VibraVox (forehead accelerometer)/Speech Enhancement/STOIVibraVox (forehead accelerometer)/Speech Recognition/Test PERVibraVox (headset microphone)/Automatic Speech Recognition (ASR)/Test PERVibraVox (headset microphone)/Speaker Verification/Test EERVibraVox (headset microphone)/Speaker Verification/Test min-DCFVibraVox (headset microphone)/Speech Recognition/Test PERVibraVox (rigid in-ear microphone)/Automatic Speech Recognition (ASR)/Test PERVibraVox (rigid in-ear microphone)/Speaker Verification/Test EERVibraVox (rigid in-ear microphone)/Speaker Verification/Test min-DCFVibraVox (rigid in-ear microphone)/Speech Enhancement/EER (ECAPA2)VibraVox (rigid in-ear microphone)/Speech Enhancement/Noresqua-MOSVibraVox (rigid in-ear microphone)/Speech Enhancement/PER (wav2vec2)VibraVox (rigid in-ear microphone)/Speech Enhancement/STOIVibraVox (rigid in-ear microphone)/Speech Recognition/Test PERVibraVox (soft in-ear microphone)/Automatic Speech Recognition (ASR)/Test PERVibraVox (soft in-ear microphone)/Speaker Verification/Test EERVibraVox (soft in-ear microphone)/Speaker Verification/Test min-DCFVibraVox (soft in-ear microphone)/Speech Enhancement/EER (ECAPA2)VibraVox (soft in-ear microphone)/Speech Enhancement/Noresqua-MOSVibraVox (soft in-ear microphone)/Speech Enhancement/PER (wav2vec2)VibraVox (soft in-ear microphone)/Speech Enhancement/STOIVibraVox (soft in-ear microphone)/Speech Recognition/Test PERVibraVox (throat microphone)/Automatic Speech Recognition (ASR)/Test PERVibraVox (throat microphone)/Speaker Verification/Test EERVibraVox (throat microphone)/Speaker Verification/Test min-DCFVibraVox (throat microphone)/Speech Enhancement/EER (ECAPA2)VibraVox (throat microphone)/Speech Enhancement/Noresqua-MOSVibraVox (throat microphone)/Speech Enhancement/PER (wav2vec2)VibraVox (throat microphone)/Speech Enhancement/STOIVibraVox (throat microphone)/Speech Recognition/Test PER

Statistics

Papers
1
Benchmarks
8

Links

Homepage

Tasks

Automatic Phoneme RecognitionAutomatic Speech Recognition (ASR)Bandwidth ExtensionSpeaker VerificationSpeech EnhancementSpeech Recognition