Whisper

Reported on 3 benchmarks across 2 tasks · 1 paper · 3 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Audio2 results

Speech RecognitiononLRS3-TED
Word Error Rate (WER)· uses extra data· 2024-06-14
0.68
SOTA
Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation arXiv:2406.10082
Speech RecognitiononLRS2
Test WER· uses extra data· 2024-06-14
1.3
SOTA
Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation arXiv:2406.10082

Speech1 result

Automatic Speech Recognition (ASR)onLRS2
Test WER· uses extra data· 2024-06-14
1.3
SOTA
Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation arXiv:2406.10082