Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Whisper v2 +demucs

Whisper v2 +demucs

Reported on 25 benchmarks across 1 task · 2 papers · 14 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Audio40 results

Speech RecognitiononJam-ALT
Case-Sensitive Word Error Rate· 2024-07-30
49.8
best: 20.1 (AudioShake v3)
SOTA
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT French
Case-Sensitive Word Error Rate· 2024-07-30
46.9
best: 23.5 (AudioShake v3)
SOTA
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT Spanish
Case-Sensitive Word Error Rate· 2024-07-30
46.5
best: 17.7 (AudioShake v3)
SOTA
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT German
Case-Sensitive Word Error Rate· 2024-07-30
70.4
best: 17.5 (AudioShake v3)
SOTA
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT English
Case-Sensitive Word Error Rate· 2024-07-30
39.1
best: 20.9 (AudioShake v3)
SOTA
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT
Case Error Rate· 2023-11-23
5.3
best: 3.4 (AudioShake v1)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT
Word Error Rate (WER)· 2023-11-23
44
best: 16.1 (AudioShake v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT French
Word Error Rate (WER)· 2023-11-23
43.3
best: 20.8 (AudioShake v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT Spanish
Case Error Rate· 2023-11-23
7.1
best: 3.6 (Whisper v3 +demucs)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT Spanish
Word Error Rate (WER)· 2023-11-23
38.8
best: 12.6 (AudioShake v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Word Error Rate (WER)· 2023-11-23
65.2
best: 12.6 (AudioShake v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Case Error Rate· 2023-11-23
5.9
best: 4 (Whisper v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Case Error Rate· 2023-11-23
5.3
best: 3.4 (AudioShake v1)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Word Error Rate (WER)· 2023-11-23
32.3
best: 17.3 (AudioShake v3)
SOTA
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT
Line break F1· 2024-07-30
61.2
best: 84.4 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT
Line break F1· 2024-07-30
61.2
best: 84.4 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT
Punctuation F1· 2024-07-30
41.6
best: 57 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT
Word Error Rate (WER)· 2024-07-30
44.5
best: 16.1 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT French
Line break F-1· 2024-07-30
66
best: 88.6 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT French
Punctuation F-1· 2024-07-30
38
best: 46.1 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT Spanish
Line break F-1· 2024-07-30
56.6
best: 82.7 (AudioShake v1)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT Spanish
Punctuation F-1· 2024-07-30
40.4
best: 56.7 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT Spanish
Word Error Rate (WER)· 2024-07-30
39.6
best: 12.6 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT German
Line break F-1· 2024-07-30
67.3
best: 83.7 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT German
Punctuation F-1· 2024-07-30
49.1
best: 57.1 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT English
Line break F-1· 2024-07-30
53.9
best: 84.3 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT English
Punctuation F-1· 2024-07-30
42.2
best: 65.3 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT English
Word Error Rate (WER)· 2024-07-30
33.3
best: 17.3 (AudioShake v3)
Lyrics Transcription for Humans: A Readability-Aware Benchmark arXiv:2408.06370
Speech RecognitiononJam-ALT
Punctuation F1· 2023-11-23
28
best: 57 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT French
Case Error Rate· 2023-11-23
3.2
best: 2 (AudioShake v1)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT French
Line break F-1· 2023-11-23
66.1
best: 88.6 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT French
Punctuation F-1· 2023-11-23
34.9
best: 46.1 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT French
Word Error Rate (WER)· 2023-11-23
43.3
best: 20.8 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT Spanish
Line break F-1· 2023-11-23
56.4
best: 82.7 (AudioShake v1)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT Spanish
Punctuation F-1· 2023-11-23
17.2
best: 56.7 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Line break F-1· 2023-11-23
67.5
best: 83.7 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Punctuation F-1· 2023-11-23
30.2
best: 57.1 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT German
Word Error Rate (WER)· 2023-11-23
65.2
best: 12.6 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Line break F-1· 2023-11-23
53.8
best: 84.3 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987
Speech RecognitiononJam-ALT English
Punctuation F-1· 2023-11-23
39.2
best: 65.3 (AudioShake v3)
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark arXiv:2311.13987