Text Summarization on X-Sum

Metric: ROUGE-2 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	ROUGE-2▼	Extra Data	Paper	Date↕	Code
1	Selfmem	26.7	No	Lift Yourself Up: Retrieval-augmented Text Gener...	2023-05-03	Code
2	BRIO	25.59	No	BRIO: Bringing Order to Abstractive Summarization	2022-03-31	Code
3	PEGASUS + SummaReranker	24.95	No	SummaReranker: A Multi-Task Mixture-of-Experts R...	2022-03-13	Code
4	PEGASUS + SimCLS	24.57	No	SimCLS: A Simple Framework for Contrastive Learn...	2021-06-03	Code
5	PEGASUSLARGE	24.56	No	PEGASUS: Pre-training with Extracted Gap-sentenc...	2019-12-18	Code
6	PaLM 2-L (one-shot)	23.2	No	PaLM 2 Technical Report	2023-05-17	Code
7	HAT-BART	22.79	No	Hierarchical Learning for Generation with Long S...	2021-04-15	-
8	BART	22.27	No	BART: Denoising Sequence-to-Sequence Pre-trainin...	2019-10-29	Code
9	PaLM 2-M (one-shot)	17.2	No	PaLM 2 Technical Report	2023-05-17	Code
10	PaLM 2-S (one-shot)	16.9	No	PaLM 2 Technical Report	2023-05-17	Code
11	BertSumExtAbs	16.5	No	Text Summarization with Pretrained Encoders	2019-08-22	Code
12	T-ConvS2S	11.54	No	Don't Give Me the Details, Just the Summary! Top...	2018-08-27	Code
13	PtGen	9.21	No	Don't Give Me the Details, Just the Summary! Top...	2018-08-27	Code
14	Baseline : Extractive Oracle	8.81	No	Don't Give Me the Details, Just the Summary! Top...	2018-08-27	Code
15	Seq2Seq	8.77	No	Don't Give Me the Details, Just the Summary! Top...	2018-08-27	Code
16	PtGen-Covg	8.02	No	Don't Give Me the Details, Just the Summary! Top...	2018-08-27	Code
17	Baseline : Random	1.78	No	Don't Give Me the Details, Just the Summary! Top...	2018-08-27	Code
18	Baseline : Lead-3	1.6	No	Don't Give Me the Details, Just the Summary! Top...	2018-08-27	Code

#1SelfmemSOTA
26.7
ROUGE-2· 2023-05-03
Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory Code
#2BRIOSOTA
25.59
ROUGE-2· 2022-03-31
BRIO: Bringing Order to Abstractive Summarization Code
#3PEGASUS + SummaRerankerSOTA
24.95
ROUGE-2· 2022-03-13
SummaReranker: A Multi-Task Mixture-of-Experts Re-ranking Framework for Abstractive Summarization Code
#4PEGASUS + SimCLSSOTA
24.57
ROUGE-2· 2021-06-03
SimCLS: A Simple Framework for Contrastive Learning of Abstractive Summarization Code
#5PEGASUSLARGESOTA
24.56
ROUGE-2· 2019-12-18
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization Code
#6PaLM 2-L (one-shot)
23.2
ROUGE-2· 2023-05-17
PaLM 2 Technical Report Code
#7HAT-BART
22.79
ROUGE-2· 2021-04-15
Hierarchical Learning for Generation with Long Source Sequences
#8BARTSOTA
22.27
ROUGE-2· 2019-10-29
BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension Code
#9PaLM 2-M (one-shot)
17.2
ROUGE-2· 2023-05-17
PaLM 2 Technical Report Code
#10PaLM 2-S (one-shot)
16.9
ROUGE-2· 2023-05-17
PaLM 2 Technical Report Code
#11BertSumExtAbsSOTA
16.5
ROUGE-2· 2019-08-22
Text Summarization with Pretrained Encoders Code
#12T-ConvS2SSOTA
11.54
ROUGE-2· 2018-08-27
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Code
#13PtGen
9.21
ROUGE-2· 2018-08-27
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Code
#14Baseline : Extractive Oracle
8.81
ROUGE-2· 2018-08-27
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Code
#15Seq2Seq
8.77
ROUGE-2· 2018-08-27
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Code
#16PtGen-Covg
8.02
ROUGE-2· 2018-08-27
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Code
#17Baseline : Random
1.78
ROUGE-2· 2018-08-27
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Code
#18Baseline : Lead-3
1.6
ROUGE-2· 2018-08-27
Don't Give Me the Details, Just the Summary! Topic-Aware Convolutional Neural Networks for Extreme Summarization Code