Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Whisper v3

Whisper v3

Reported on 28 benchmarks across 1 task · 2 papers · 15 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Audio46 results

Speech RecognitiononJam-ALT
Case-Sensitive Word Error Rate· 2024-07-30
39.7
best: 20.1 (AudioShake v3)
SOTA
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT French
Case-Sensitive Word Error Rate· 2024-07-30
38
best: 23.5 (AudioShake v3)
SOTA
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT Spanish
Case-Sensitive Word Error Rate· 2024-07-30
33.6
best: 17.7 (AudioShake v3)
SOTA
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT German
Case-Sensitive Word Error Rate· 2024-07-30
44.6
best: 17.5 (AudioShake v3)
SOTA
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT English
Case-Sensitive Word Error Rate· 2024-07-30
42.5
best: 20.9 (AudioShake v3)
SOTA
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT
Word Error Rate (WER)· 2023-11-23
35.5
best: 16.1 (AudioShake v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT
Case Error Rate· 2023-11-23
4.3
best: 3.4 (AudioShake v1)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT French
Word Error Rate (WER)· 2023-11-23
34.7
best: 20.8 (AudioShake v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT French
Case Error Rate· 2023-11-23
3.3
best: 2 (AudioShake v1)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT Spanish
Word Error Rate (WER)· 2023-11-23
28.6
best: 12.6 (AudioShake v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT Spanish
Case Error Rate· 2023-11-23
5
best: 3.6 (Whisper v3 +demucs)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Word Error Rate (WER)· 2023-11-23
40.7
best: 12.6 (AudioShake v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Case Error Rate· 2023-11-23
4
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Word Error Rate (WER)· 2023-11-23
37.7
best: 17.3 (AudioShake v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Case Error Rate· 2023-11-23
4.8
best: 3.4 (AudioShake v1)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT
Punctuation F1· 2024-07-30
43
best: 57 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT French
Line break F-1· 2024-07-30
77.9
best: 88.6 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT French
Punctuation F-1· 2024-07-30
42.5
best: 46.1 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT Spanish
Punctuation F-1· 2024-07-30
42.5
best: 56.7 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT German
Line break F-1· 2024-07-30
71.1
best: 83.7 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT German
Punctuation F-1· 2024-07-30
47.3
best: 57.1 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT English
Punctuation F-1· 2024-07-30
41.4
best: 65.3 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT
Line break F1· 2023-11-23
73.5
best: 84.4 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT
Section break F1· 2023-11-23
1
best: 73.9 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT
Line break F1· 2023-11-23
73.5
best: 84.4 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT
Punctuation F1· 2023-11-23
41.6
best: 57 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT
Section break F1· 2023-11-23
1
best: 73.9 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT
Word Error Rate (WER)· 2023-11-23
35.5
best: 16.1 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT French
Line break F-1· 2023-11-23
77.8
best: 88.6 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT French
Punctuation F-1· 2023-11-23
42.4
best: 46.1 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT French
Word Error Rate (WER)· 2023-11-23
34.7
best: 20.8 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT Spanish
Line break F-1· 2023-11-23
73.7
best: 82.7 (AudioShake v1)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT Spanish
Line break F-1· 2023-11-23
73.7
best: 82.7 (AudioShake v1)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT Spanish
Punctuation F-1· 2023-11-23
41.9
best: 56.7 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT Spanish
Word Error Rate (WER)· 2023-11-23
28.6
best: 12.6 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Section break F-1· 2023-11-23
1.2
best: 74.5 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Line break F-1· 2023-11-23
71.2
best: 83.7 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Punctuation F-1· 2023-11-23
41.2
best: 57.1 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Section break F-1· 2023-11-23
1.2
best: 74.5 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Word Error Rate (WER)· 2023-11-23
40.7
best: 12.6 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Line break F-1· 2023-11-23
71.5
best: 84.3 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Section break F-1· 2023-11-23
2.6
best: 84.8 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Line break F-1· 2023-11-23
71.5
best: 84.3 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Punctuation F-1· 2023-11-23
40.9
best: 65.3 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Section break F-1· 2023-11-23
2.6
best: 84.8 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Word Error Rate (WER)· 2023-11-23
37.7
best: 17.3 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987