Speech Recognition on Jam-ALT English

Metric: Punctuation F-1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Punctuation F-1▼	Extra Data	Paper	Date↕	Code
1	AudioShake v3	65.3	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code
2	AudioShake v1	59	No	Jam-ALT: A Formatting-Aware Lyrics Transcription...	2023-11-23	Code
3	Whisper v2 +demucs	42.2	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code
4	Whisper v2 +demucs +lang	41.8	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code
5	Whisper v3 +lang	41.8	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code
6	Whisper v3	41.4	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code
7	Whisper v3	40.9	No	Jam-ALT: A Formatting-Aware Lyrics Transcription...	2023-11-23	Code
8	Whisper v2 +demucs	39.2	No	Jam-ALT: A Formatting-Aware Lyrics Transcription...	2023-11-23	Code
9	Whisper v2 +lang	34.9	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code
10	LyricWhiz	34	No	Jam-ALT: A Formatting-Aware Lyrics Transcription...	2023-11-23	Code
11	LyricWhiz	34	No	Jam-ALT: A Formatting-Aware Lyrics Transcription...	2023-11-23	Code
12	Whisper v2	31.5	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code
13	Whisper v2	31.3	No	Jam-ALT: A Formatting-Aware Lyrics Transcription...	2023-11-23	Code
14	Whisper v3 +demucs	25.8	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code
15	Whisper v3 +demucs +lang	25.8	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code
16	Whisper v3 +demucs	23.3	No	Jam-ALT: A Formatting-Aware Lyrics Transcription...	2023-11-23	Code
17	OWSM v3.1 +lang	22.3	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code
18	OWSM v3.1 +demucs +lang	21.5	No	Lyrics Transcription for Humans: A Readability-A...	2024-07-30	Code

#1AudioShake v3SOTA
65.3
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code
#2AudioShake v1SOTA
59
Punctuation F-1· 2023-11-23
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark Code
#3Whisper v2 +demucs
42.2
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code
#4Whisper v2 +demucs +lang
41.8
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code
#5Whisper v3 +lang
41.8
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code
#6Whisper v3
41.4
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code
#7Whisper v3
40.9
Punctuation F-1· 2023-11-23
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark Code
#8Whisper v2 +demucs
39.2
Punctuation F-1· 2023-11-23
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark Code
#9Whisper v2 +lang
34.9
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code
#10LyricWhiz
34
Punctuation F-1· 2023-11-23
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark Code
#11LyricWhiz
34
Punctuation F-1· 2023-11-23
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark Code
#12Whisper v2
31.5
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code
#13Whisper v2
31.3
Punctuation F-1· 2023-11-23
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark Code
#14Whisper v3 +demucs
25.8
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code
#15Whisper v3 +demucs +lang
25.8
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code
#16Whisper v3 +demucs
23.3
Punctuation F-1· 2023-11-23
Jam-ALT: A Formatting-Aware Lyrics Transcription Benchmark Code
#17OWSM v3.1 +lang
22.3
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code
#18OWSM v3.1 +demucs +lang
21.5
Punctuation F-1· 2024-07-30
Lyrics Transcription for Humans: A Readability-Aware Benchmark Code