Abstractive Text Summarization on CNN / Daily Mail

Metric: ROUGE-L (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	ROUGE-L▼	Extra Data	Paper	Date↕	Code
1	Scrambled code + broken (alter)	45.35	No	Universal Evasion Attacks on Summarization Scoring	2022-10-25	Code
2	BRIO	44.57	No	BRIO: Bringing Order to Abstractive Summarization	2022-03-31	Code
3	Pegasus	44.45	No	Calibrating Sequence likelihood Improves Conditi...	2022-09-30	-
4	PEGASUS + SummaReranker	43.87	No	SummaReranker: A Multi-Task Mixture-of-Experts R...	2022-03-13	Code
5	Scrambled code + broken	43.56	No	Universal Evasion Attacks on Summarization Scoring	2022-10-25	Code
6	BART + SimCLS	43.54	No	SimCLS: A Simple Framework for Contrastive Learn...	2021-06-03	Code
7	SEASON	43.08	No	Salience Allocation as Guidance for Abstractive ...	2022-10-22	Code
8	ERNIE-GENLARGE (large-scale text corpora)	41.6	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
9	PALM	41.41	No	PALM: Pre-training an Autoencoding&Autoregressiv...	2020-04-14	Code
10	GLM-XXLarge	41.4	Yes	GLM: General Language Model Pretraining with Aut...	2021-03-18	Code
11	MUPPET BART Large	41.4	No	Muppet: Massive Multi-task Representations with ...	2021-01-26	Code
12	Fourier Transformer	41.34	No	Fourier Transformer: Fast Long Range Modeling by...	2023-05-24	Code
13	ProphetNet	41.3	Yes	ProphetNet: Predicting Future N-gram for Sequenc...	2020-01-13	Code
14	LongT5	41.28	No	LongT5: Efficient Text-To-Text Transformer for L...	2021-12-15	Code
15	ERNIE-GENLARGE	41.26	No	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
16	BART + R-Drop	41.24	No	R-Drop: Regularized Dropout for Neural Networks	2021-06-28	Code
17	CoCoNet + CoCoPretrain	41.24	Yes	-	-	Code
18	BART+R3F	41.17	No	Better Fine-Tuning by Reducing Representational ...	2020-08-06	Code
19	PEGASUS	41.11	Yes	PEGASUS: Pre-training with Extracted Gap-sentenc...	2019-12-18	Code
20	CoCoNet	41.05	No	-	-	Code
21	BART	40.9	No	BART: Denoising Sequence-to-Sequence Pre-trainin...	2019-10-29	Code
22	T5	40.69	No	Exploring the Limits of Transfer Learning with a...	2019-10-23	Code
23	SRformer-BART	40.4	No	Segmented Recurrent Transformer: An Efficient Se...	2023-05-24	Code
24	UniLM	40.34	Yes	Unified Language Model Pre-training for Natural ...	2019-05-08	Code
25	UniLMv2	40.14	Yes	UniLMv2: Pseudo-Masked Language Models for Unifi...	2020-02-28	Code
26	ERNIE-GENBASE	39.68	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
27	BERT-ext + abs + RL + rerank	39.64	No	Summary Level Training of Sentence Rewriting for...	2019-09-19	-
28	BertSumExtAbs	39.18	Yes	Text Summarization with Pretrained Encoders	2019-08-22	Code
29	Selector & Pointer-Generator	38.79	Yes	Mixture Content Selection for Diverse Sequence G...	2019-09-04	Code
30	Two-Stage + RL	38.79	No	Pretraining-Based Natural Language Generation fo...	2019-02-25	Code
31	rnn-ext + abs + RL + rerank	38.54	No	Fast Abstractive Summarization with Reinforce-Se...	2018-05-28	Code
32	EditNet	38.36	No	An Editorial Network for Enhanced Document Summa...	2019-02-27	-
33	Bottom-Up Summarization	38.34	No	Bottom-Up Abstractive Summarization	2018-08-31	Code
34	DCA	37.92	Yes	Deep Communicating Agents for Abstractive Summar...	2018-03-27	-
35	Mask Attention Network	37.88	No	Mask Attention Networks: Rethinking and Strength...	2021-03-25	Code
36	rnn-ext + RL	37.76	No	Fast Abstractive Summarization with Reinforce-Se...	2018-05-28	Code
37	Subformer-base	37.7	No	-	-	-
38	ML+RL ROUGE+Novel, with LM	37.52	No	Improving Abstraction in Text Summarization	2018-08-23	-
39	Li et al.	37.36	No	-	-	-
40	end2end w/ inconsistency loss	37.13	No	A Unified Model for Extractive and Abstractive S...	2018-05-16	Code
41	ROUGESal+Ent RL	37.1	No	Multi-Reward Reinforced Summarization with Salie...	2018-04-17	-
42	RL + pg + cbdec	37.06	No	Closed-Book Training to Improve Summarization En...	2018-09-12	-
43	Dynamic Conv	36.73	No	Pay Less Attention with Lightweight and Dynamic ...	2019-01-29	Code
44	LEAD-3	36.67	No	Abstractive Text Summarization Using Sequence-to...	2016-02-19	Code
45	Transformer	36.63	No	Attention Is All You Need	2017-06-12	Code
46	Pointer + Coverage + EntailmentGen + QuestionGen	36.54	No	Soft Layer-Specific Multi-Task Summarization wit...	2018-05-28	-
47	Li et al.	36.47	No	-	-	-
48	PTGEN + Coverage	36.38	No	Get To The Point: Summarization with Pointer-Gen...	2017-04-14	Code
49	PTGEN + Coverage	36.38	No	Get To The Point: Summarization with Pointer-Gen...	2017-04-14	Code
50	CriSPO 3-shot	27.4	No	CriSPO: Multi-Aspect Critique-Suggestion-guided ...	2024-10-03	Code
51	DELTA (BLSTM)	27.3	No	DELTA: A DEep learning based Language Technology...	2019-08-02	Code