Text Summarization on GigaWord

Metric: ROUGE-1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	ROUGE-1▼	Extra Data	Paper	Date↕	Code
1	OpenAI/o3-mini	60.12	No	-	-	-
2	Riple/Saanvi-v0.1	52.21	No	-	-	-
3	Pegasus+DotProd	40.6	Yes	-	-	-
4	BART-RXF	40.45	No	Better Fine-Tuning by Reducing Representational ...	2020-08-06	Code
5	MUPPET BART Large	40.4	Yes	Muppet: Massive Multi-task Representations with ...	2021-01-26	Code
6	OFA	39.81	No	OFA: Unifying Architectures, Tasks, and Modaliti...	2022-02-07	Code
7	Transformer+Rep(Uni)	39.81	Yes	Rethinking Perturbations in Encoder-Decoders for...	2021-04-05	Code
8	Transformer+Wdrop	39.66	Yes	Rethinking Perturbations in Encoder-Decoders for...	2021-04-05	Code
9	ProphetNet	39.51	Yes	ProphetNet: Predicting Future N-gram for Sequenc...	2020-01-13	Code
10	ERNIE-GENLARGE (large-scale text corpora)	39.46	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
11	PALM	39.45	No	PALM: Pre-training an Autoencoding&Autoregressiv...	2020-04-14	Code
12	Best Summary Length	39.27	No	A New Approach to Overgenerating and Scoring Abs...	2021-04-05	Code
13	ERNIE-GENLARGE	39.25	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
14	ControlCopying + BPNorm	39.19	No	Controlling the Amount of Verbatim Copying in Ab...	2019-11-23	Code
15	PEGASUS	39.12	Yes	PEGASUS: Pre-training with Extracted Gap-sentenc...	2019-12-18	Code
16	BiSET	39.11	No	BiSET: Bi-directional Selective Encoding with Te...	2019-06-12	Code
17	ControlCopying + SBWR	39.08	No	Controlling the Amount of Verbatim Copying in Ab...	2019-11-23	Code
18	UniLM	38.9	Yes	Unified Language Model Pre-training for Natural ...	2019-05-08	Code
19	ERNIE-GENBASE	38.83	Yes	ERNIE-GEN: An Enhanced Multi-Flow Pre-training a...	2020-01-26	Code
20	MASS	38.73	Yes	MASS: Masked Sequence to Sequence Pre-training f...	2019-05-07	Code
21	Mask Attention Network	38.28	No	Mask Attention Networks: Rethinking and Strength...	2021-03-25	Code
22	Concept pointer+RL	38.02	No	Concept Pointer Network for Abstractive Summariz...	2019-10-18	Code
23	Transformer	37.57	No	Attention Is All You Need	2017-06-12	Code
24	FTSum_g	37.27	No	Faithful to the Original: Fact Aware Neural Abst...	2017-11-13	-
25	Re^3 Sum	37.04	No	-	-	-
26	Seq2seq + E2T_cnn	37.04	No	Entity Commonsense Representation for Neural Abs...	2018-06-14	Code
27	Concept pointer+DS	37.01	No	Concept Pointer Network for Abstractive Summariz...	2019-10-18	Code
28	Reinforced-Topic-ConvS2S	36.92	No	A Reinforced Topic-Aware Convolutional Sequence-...	2018-05-09	-
29	JointParsing	36.61	No	Joint Parsing and Generation for Abstractive Sum...	2019-11-23	Code
30	words-lvt5k-1sent	36.4	No	Abstractive Text Summarization Using Sequence-to...	2016-02-19	Code
31	CGU	36.3	No	Global Encoding for Abstractive Summarization	2018-05-10	Code
32	EndDec+WFE	36.3	No	Cutting-off Redundant Repeating Generations for ...	2016-12-31	-
33	DRGD	36.27	No	Deep Recurrent Generative Decoder for Abstractiv...	2017-08-02	Code
34	SEASS	36.15	No	Selective Encoding for Abstractive Sentence Summ...	2017-04-24	Code
35	Pointer + Coverage + EntailmentGen + QuestionGen	35.98	No	Soft Layer-Specific Multi-Task Summarization wit...	2018-05-28	-
36	Struct+2Way+Word	35.47	No	Structure-Infused Copy Mechanisms for Abstractiv...	2018-06-14	Code
37	Seq2seq + selective + MTL + ERAM	35.33	No	-	-	-
38	RAS-Elman	33.78	No	-	-	-
39	Abs+	31	No	A Neural Attention Model for Abstractive Sentenc...	2015-09-02	Code
40	Abs	30.88	No	A Neural Attention Model for Abstractive Sentenc...	2015-09-02	Code
41	Contextual Match	26.48	No	Simple Unsupervised Summarization by Contextual ...	2019-07-31	Code