Text Summarization on GigaWord

Metric: ROUGE-L (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	ROUGE-L▼	Extra Data	Paper	Date↕	Code
1	Riple/Saanvi-v0.1	60.29	No	-	-	-
2	OpenAI/o3-mini	57.21	No	-	-	-
3	Best Summary Length	37.75	No	A New Approach to Overgenerating and Scoring Abs...	2021-04-05	Code
4	OFA	37.11	No	OFA: Unifying Architectures, Tasks, and Modaliti...	2022-02-07	Code
5	Pegasus+DotProd	37	Yes	-	-	-
6	Transformer+Rep(Uni)	36.93	Yes	Rethinking Perturbations in Encoder-Decoders for...	2021-04-05	Code
7	BiSET	36.87	No	BiSET: Bi-directional Selective Encoding with Te...	2019-06-12	Code
8	PALM	36.75	No	PALM: Pre-training an Autoencoding&Autoregressiv...	2020-04-14	Code
9	ERNIE-GENLARGE (large-scale text corpora)	36.74	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
10	ProphetNet	36.69	Yes	ProphetNet: Predicting Future N-gram for Sequenc...	2020-01-13	Code
11	ControlCopying + BPNorm	36.69	No	Controlling the Amount of Verbatim Copying in Ab...	2019-11-23	Code
12	ControlCopying + SBWR	36.69	No	Controlling the Amount of Verbatim Copying in Ab...	2019-11-23	Code
13	Transformer+Wdrop	36.59	Yes	Rethinking Perturbations in Encoder-Decoders for...	2021-04-05	Code
14	BART-RXF	36.56	No	Better Fine-Tuning by Reducing Representational ...	2020-08-06	Code
15	ERNIE-GENLARGE	36.53	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
16	PEGASUS	36.24	Yes	PEGASUS: Pre-training with Extracted Gap-sentenc...	2019-12-18	Code
17	MUPPET BART Large	36.21	Yes	Muppet: Massive Multi-task Representations with ...	2021-01-26	Code
18	ERNIE-GENBASE	36.2	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
19	UniLM	36	Yes	Unified Language Model Pre-training for Natural ...	2019-05-08	Code
20	MASS	35.96	Yes	MASS: Masked Sequence to Sequence Pre-training f...	2019-05-07	Code
21	Mask Attention Network	35.46	No	Mask Attention Networks: Rethinking and Strength...	2021-03-25	Code
22	Concept pointer+RL	35.43	No	Concept Pointer Network for Abstractive Summariz...	2019-10-18	Code
23	Seq2seq + E2T_cnn	34.93	No	Entity Commonsense Representation for Neural Abs...	2018-06-14	Code
24	Concept pointer+DS	34.87	No	Concept Pointer Network for Abstractive Summariz...	2019-10-18	Code
25	Transformer	34.69	No	Attention Is All You Need	2017-06-12	Code
26	Reinforced-Topic-ConvS2S	34.58	No	A Reinforced Topic-Aware Convolutional Sequence-...	2018-05-09	-
27	Re^3 Sum	34.46	No	-	-	-
28	JointParsing	34.33	No	Joint Parsing and Generation for Abstractive Sum...	2019-11-23	Code
29	FTSum_g	34.24	No	Faithful to the Original: Fact Aware Neural Abst...	2017-11-13	-
30	EndDec+WFE	33.88	No	Cutting-off Redundant Repeating Generations for ...	2016-12-31	-
31	CGU	33.8	No	Global Encoding for Abstractive Summarization	2018-05-10	Code
32	words-lvt5k-1sent	33.71	No	Abstractive Text Summarization Using Sequence-to...	2016-02-19	Code
33	SEASS	33.63	No	Selective Encoding for Abstractive Sentence Summ...	2017-04-24	Code
34	Pointer + Coverage + EntailmentGen + QuestionGen	33.63	No	Soft Layer-Specific Multi-Task Summarization wit...	2018-05-28	-
35	DRGD	33.62	No	Deep Recurrent Generative Decoder for Abstractiv...	2017-08-02	Code
36	Struct+2Way+Word	33.52	No	Structure-Infused Copy Mechanisms for Abstractiv...	2018-06-14	Code
37	Seq2seq + selective + MTL + ERAM	33.19	No	-	-	-
38	RAS-Elman	31.15	No	-	-	-
39	Contextual Match	24.41	No	Simple Unsupervised Summarization by Contextual ...	2019-07-31	Code

#1Riple/Saanvi-v0.1
60.29
ROUGE-L
No paper
#2OpenAI/o3-mini
57.21
ROUGE-L
No paper
#3Best Summary LengthSOTA
37.75
ROUGE-L· 2021-04-05
A New Approach to Overgenerating and Scoring Abstractive Summaries Code
#4OFA
37.11
ROUGE-L· 2022-02-07
OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework Code
#5Pegasus+DotProd
37
ROUGE-L· Extra Data
No paper
#6Transformer+Rep(Uni)
36.93
ROUGE-L· Extra Data· 2021-04-05
Rethinking Perturbations in Encoder-Decoders for Fast Training Code
#7BiSETSOTA
36.87
ROUGE-L· 2019-06-12
BiSET: Bi-directional Selective Encoding with Template for Abstractive Summarization Code
#8PALM
36.75
ROUGE-L· 2020-04-14
PALM: Pre-training an Autoencoding&Autoregressive Language Model for Context-conditioned Generation Code
#9ERNIE-GENLARGE (large-scale text corpora)
36.74
ROUGE-L· Extra Data· 2020-01-26
ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation Code
#10ProphetNet
36.69
ROUGE-L· Extra Data· 2020-01-13
ProphetNet: Predicting Future N-gram for Sequence-to-Sequence Pre-training Code
#11ControlCopying + BPNorm
36.69
ROUGE-L· 2019-11-23
Controlling the Amount of Verbatim Copying in Abstractive Summarization Code
#12ControlCopying + SBWR
36.69
ROUGE-L· 2019-11-23
Controlling the Amount of Verbatim Copying in Abstractive Summarization Code
#13Transformer+Wdrop
36.59
ROUGE-L· Extra Data· 2021-04-05
Rethinking Perturbations in Encoder-Decoders for Fast Training Code
#14BART-RXF
36.56
ROUGE-L· 2020-08-06
Better Fine-Tuning by Reducing Representational Collapse Code
#15ERNIE-GENLARGE
36.53
ROUGE-L· Extra Data· 2020-01-26
ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation Code
#16PEGASUS
36.24
ROUGE-L· Extra Data· 2019-12-18
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization Code
#17MUPPET BART Large
36.21
ROUGE-L· Extra Data· 2021-01-26
Muppet: Massive Multi-task Representations with Pre-Finetuning Code
#18ERNIE-GENBASE
36.2
ROUGE-L· Extra Data· 2020-01-26
ERNIE-GEN: An Enhanced Multi-Flow Pre-training and Fine-tuning Framework for Natural Language Generation Code
#19UniLMSOTA
36
ROUGE-L· Extra Data· 2019-05-08
Unified Language Model Pre-training for Natural Language Understanding and Generation Code
#20MASSSOTA
35.96
ROUGE-L· Extra Data· 2019-05-07
MASS: Masked Sequence to Sequence Pre-training for Language Generation Code
#21Mask Attention Network
35.46
ROUGE-L· 2021-03-25
Mask Attention Networks: Rethinking and Strengthen Transformer Code
#22Concept pointer+RL
35.43
ROUGE-L· 2019-10-18
Concept Pointer Network for Abstractive Summarization Code
#23Seq2seq + E2T_cnnSOTA
34.93
ROUGE-L· 2018-06-14
Entity Commonsense Representation for Neural Abstractive Summarization Code
#24Concept pointer+DS
34.87
ROUGE-L· 2019-10-18
Concept Pointer Network for Abstractive Summarization Code
#25TransformerSOTA
34.69
ROUGE-L· 2017-06-12
Attention Is All You Need Code
#26Reinforced-Topic-ConvS2S
34.58
ROUGE-L· 2018-05-09
A Reinforced Topic-Aware Convolutional Sequence-to-Sequence Model for Abstractive Text Summarization
#27Re^3 Sum
34.46
ROUGE-L
No paper
#28JointParsing
34.33
ROUGE-L· 2019-11-23
Joint Parsing and Generation for Abstractive Summarization Code
#29FTSum_g
34.24
ROUGE-L· 2017-11-13
Faithful to the Original: Fact Aware Neural Abstractive Summarization
#30EndDec+WFESOTA
33.88
ROUGE-L· 2016-12-31
Cutting-off Redundant Repeating Generations for Neural Abstractive Summarization
#31CGU
33.8
ROUGE-L· 2018-05-10
Global Encoding for Abstractive Summarization Code
#32words-lvt5k-1sentSOTA
33.71
ROUGE-L· 2016-02-19
Abstractive Text Summarization Using Sequence-to-Sequence RNNs and Beyond Code
#33SEASS
33.63
ROUGE-L· 2017-04-24
Selective Encoding for Abstractive Sentence Summarization Code
#34Pointer + Coverage + EntailmentGen + QuestionGen
33.63
ROUGE-L· 2018-05-28
Soft Layer-Specific Multi-Task Summarization with Entailment and Question Generation
#35DRGD
33.62
ROUGE-L· 2017-08-02
Deep Recurrent Generative Decoder for Abstractive Text Summarization Code
#36Struct+2Way+Word
33.52
ROUGE-L· 2018-06-14
Structure-Infused Copy Mechanisms for Abstractive Summarization Code
#37Seq2seq + selective + MTL + ERAM
33.19
ROUGE-L
No paper
#38RAS-Elman
31.15
ROUGE-L
No paper
#39Contextual Match
24.41
ROUGE-L· 2019-07-31
Simple Unsupervised Summarization by Contextual Matching Code