Text Summarization on GigaWord

Metric: ROUGE-L (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	ROUGE-L▼	Extra Data	Paper	Date↕	Code
1	Riple/Saanvi-v0.1	60.29	No	-	-	-
2	OpenAI/o3-mini	57.21	No	-	-	-
3	Best Summary Length	37.75	No	A New Approach to Overgenerating and Scoring Abs...	2021-04-05	Code
4	OFA	37.11	No	OFA: Unifying Architectures, Tasks, and Modaliti...	2022-02-07	Code
5	Pegasus+DotProd	37	Yes	-	-	-
6	Transformer+Rep(Uni)	36.93	Yes	Rethinking Perturbations in Encoder-Decoders for...	2021-04-05	Code
7	BiSET	36.87	No	BiSET: Bi-directional Selective Encoding with Te...	2019-06-12	Code
8	PALM	36.75	No	PALM: Pre-training an Autoencoding&Autoregressiv...	2020-04-14	Code
9	ERNIE-GENLARGE (large-scale text corpora)	36.74	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
10	ProphetNet	36.69	Yes	ProphetNet: Predicting Future N-gram for Sequenc...	2020-01-13	Code
11	ControlCopying + BPNorm	36.69	No	Controlling the Amount of Verbatim Copying in Ab...	2019-11-23	Code
12	ControlCopying + SBWR	36.69	No	Controlling the Amount of Verbatim Copying in Ab...	2019-11-23	Code
13	Transformer+Wdrop	36.59	Yes	Rethinking Perturbations in Encoder-Decoders for...	2021-04-05	Code
14	BART-RXF	36.56	No	Better Fine-Tuning by Reducing Representational ...	2020-08-06	Code
15	ERNIE-GENLARGE	36.53	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
16	PEGASUS	36.24	Yes	PEGASUS: Pre-training with Extracted Gap-sentenc...	2019-12-18	Code
17	MUPPET BART Large	36.21	Yes	Muppet: Massive Multi-task Representations with ...	2021-01-26	Code
18	ERNIE-GENBASE	36.2	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
19	UniLM	36	Yes	Unified Language Model Pre-training for Natural ...	2019-05-08	Code
20	MASS	35.96	Yes	MASS: Masked Sequence to Sequence Pre-training f...	2019-05-07	Code
21	Mask Attention Network	35.46	No	Mask Attention Networks: Rethinking and Strength...	2021-03-25	Code
22	Concept pointer+RL	35.43	No	Concept Pointer Network for Abstractive Summariz...	2019-10-18	Code
23	Seq2seq + E2T_cnn	34.93	No	Entity Commonsense Representation for Neural Abs...	2018-06-14	Code
24	Concept pointer+DS	34.87	No	Concept Pointer Network for Abstractive Summariz...	2019-10-18	Code
25	Transformer	34.69	No	Attention Is All You Need	2017-06-12	Code
26	Reinforced-Topic-ConvS2S	34.58	No	A Reinforced Topic-Aware Convolutional Sequence-...	2018-05-09	-
27	Re^3 Sum	34.46	No	-	-	-
28	JointParsing	34.33	No	Joint Parsing and Generation for Abstractive Sum...	2019-11-23	Code
29	FTSum_g	34.24	No	Faithful to the Original: Fact Aware Neural Abst...	2017-11-13	-
30	EndDec+WFE	33.88	No	Cutting-off Redundant Repeating Generations for ...	2016-12-31	-
31	CGU	33.8	No	Global Encoding for Abstractive Summarization	2018-05-10	Code
32	words-lvt5k-1sent	33.71	No	Abstractive Text Summarization Using Sequence-to...	2016-02-19	Code
33	SEASS	33.63	No	Selective Encoding for Abstractive Sentence Summ...	2017-04-24	Code
34	Pointer + Coverage + EntailmentGen + QuestionGen	33.63	No	Soft Layer-Specific Multi-Task Summarization wit...	2018-05-28	-
35	DRGD	33.62	No	Deep Recurrent Generative Decoder for Abstractiv...	2017-08-02	Code
36	Struct+2Way+Word	33.52	No	Structure-Infused Copy Mechanisms for Abstractiv...	2018-06-14	Code
37	Seq2seq + selective + MTL + ERAM	33.19	No	-	-	-
38	RAS-Elman	31.15	No	-	-	-
39	Contextual Match	24.41	No	Simple Unsupervised Summarization by Contextual ...	2019-07-31	Code