Language Modelling on SALMon

Metric: Background Alignment (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Hide extra data

Sort:

#	Model↕	Background Alignment▼	Extra Data	Paper	Date↕	Code
1	Spirit-LM (Expr.)	59.5	Yes	Spirit LM: Interleaved Spoken and Written Langua...	2024-02-08	Code
2	TWIST 1.3B	56.5	Yes	Textually Pretrained Speech Language Models	2023-05-22	Code
3	TWIST 350M	56.5	Yes	Textually Pretrained Speech Language Models	2023-05-22	Code
4	LAST 350M	54.5	Yes	LAST: Language Model Aware Speech Tokenization	2024-09-05	-
5	TWIST 7B	54.5	Yes	Textually Pretrained Speech Language Models	2023-05-22	Code
6	pGSLM	53.5	Yes	Text-Free Prosody-Aware Generative Spoken Langua...	2021-09-07	Code
7	LAST 1.3B	53	Yes	LAST: Language Model Aware Speech Tokenization	2024-09-05	-
8	Spirit-LM (base)	51.5	Yes	Spirit LM: Interleaved Spoken and Written Langua...	2024-02-08	Code

#1Spirit-LM (Expr.)SOTA
59.5
Background Alignment· Extra Data· 2024-02-08
Spirit LM: Interleaved Spoken and Written Language Model Code
#2TWIST 1.3BSOTA
56.5
Background Alignment· Extra Data· 2023-05-22
Textually Pretrained Speech Language Models Code
#3TWIST 350M
56.5
Background Alignment· Extra Data· 2023-05-22
Textually Pretrained Speech Language Models Code
#4LAST 350M
54.5
Background Alignment· Extra Data· 2024-09-05
LAST: Language Model Aware Speech Tokenization
#5TWIST 7B
54.5
Background Alignment· Extra Data· 2023-05-22
Textually Pretrained Speech Language Models Code
#6pGSLMSOTA
53.5
Background Alignment· Extra Data· 2021-09-07
Text-Free Prosody-Aware Generative Spoken Language Modeling Code
#7LAST 1.3B
53
Background Alignment· Extra Data· 2024-09-05
LAST: Language Model Aware Speech Tokenization
#8Spirit-LM (base)
51.5
Background Alignment· Extra Data· 2024-02-08
Spirit LM: Interleaved Spoken and Written Language Model Code