Text Summarization on Arxiv HEP-TH citation graph

Metric: ROUGE-1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	ROUGE-1▼	Extra Data	Paper	Date↕	Code
1	Top Down Transformer (AdaPool) (464M)	50.95	No	Long Document Summarization with Top-down and Bo...	2022-03-15	Code
2	BART-LS	50.2	No	Adapting Pretrained Text-to-Text Models for Long...	2022-09-21	Code
3	Pegasus-X	50	No	Investigating Efficiently Extending Transformers...	2022-08-08	Code
4	ExtSum + oracle segmentation (extractive)	49.49	No	Document Summarization with Text Segmentation	2023-01-20	-
5	FactorSum	49.32	No	Factorizing Content and Budget Decisions in Abst...	2022-05-25	Code
6	ExtSum + supervised segmentation (extractive)	49.11	No	Document Summarization with Text Segmentation	2023-01-20	-
7	Lodoss-full-large (extractive)	48.45	No	Toward Unifying Text Segmentation and Long Docum...	2022-10-28	Code
8	MemSum (extractive)	48.42	No	MemSum: Extractive Summarization of Long Documen...	2021-07-19	Code
9	LongT5	48.35	No	LongT5: Efficient Text-To-Text Transformer for L...	2021-12-15	Code
10	Lodoss-full-base (extractive)	48.2	No	Toward Unifying Text Segmentation and Long Docum...	2022-10-28	Code
11	DeepPyramidion	47.15	No	-	-	-
12	DeepPyramidion	47.15	No	-	-	-
13	Blockwise(baseline)	46.85	No	-	-	-
14	HAT-BART	46.74	Yes	Hierarchical Learning for Generation with Long S...	2021-04-15	-
15	HiStruct+	45.22	No	HiStruct+: Improving Extractive Text Summarizati...	2022-03-17	-
16	DANCER PEGASUS	45.01	Yes	A Divide-and-Conquer Approach to the Summarizati...	2020-04-13	Code
17	PEGASUS	44.67	Yes	PEGASUS: Pre-training with Extracted Gap-sentenc...	2019-12-18	Code
18	ExtSum-LG+RdLoss	44.01	No	Systematically Exploring Redundancy Reduction in...	2020-11-30	Code
19	ExtSum-LG+MMR-Select+	43.87	No	Systematically Exploring Redundancy Reduction in...	2020-11-30	Code
20	ExtSum-LG	43.58	No	Extractive Summarization of Long Documents by Co...	2019-09-17	Code
21	SRformer-BART	42.99	No	Segmented Recurrent Transformer: An Efficient Se...	2023-05-24	Code
22	DANCER RUM	42.7	No	A Divide-and-Conquer Approach to the Summarizati...	2020-04-13	Code
23	TLM-I+E	42.43	No	On Extractive and Abstractive Neural Document Su...	2019-09-07	Code
24	Sent-PTR	42.32	No	On Extractive and Abstractive Neural Document Su...	2019-09-07	Code
25	DANCER LSTM	41.87	No	A Divide-and-Conquer Approach to the Summarizati...	2020-04-13	Code
26	GenCompareSum	39.96	No	-	-	Code
27	Discourse	35.8	No	A Discourse-Aware Attention Model for Abstractiv...	2018-04-16	Code
28	Sent-CLF	34.01	No	On Extractive and Abstractive Neural Document Su...	2019-09-07	Code
29	Pntr-Gen-Seq2Seq	32.06	No	Get To The Point: Summarization with Pointer-Gen...	2017-04-14	Code

#1Top Down Transformer (AdaPool) (464M)SOTA
50.95
ROUGE-1· 2022-03-15
Long Document Summarization with Top-down and Bottom-up Inference Code
#2BART-LS
50.2
ROUGE-1· 2022-09-21
Adapting Pretrained Text-to-Text Models for Long Text Sequences Code
#3Pegasus-X
50
ROUGE-1· 2022-08-08
Investigating Efficiently Extending Transformers for Long Input Summarization Code
#4ExtSum + oracle segmentation (extractive)
49.49
ROUGE-1· 2023-01-20
Document Summarization with Text Segmentation
#5FactorSum
49.32
ROUGE-1· 2022-05-25
Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documents Code
#6ExtSum + supervised segmentation (extractive)
49.11
ROUGE-1· 2023-01-20
Document Summarization with Text Segmentation
#7Lodoss-full-large (extractive)
48.45
ROUGE-1· 2022-10-28
Toward Unifying Text Segmentation and Long Document Summarization Code
#8MemSum (extractive)SOTA
48.42
ROUGE-1· 2021-07-19
MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processes Code
#9LongT5
48.35
ROUGE-1· 2021-12-15
LongT5: Efficient Text-To-Text Transformer for Long Sequences Code
#10Lodoss-full-base (extractive)
48.2
ROUGE-1· 2022-10-28
Toward Unifying Text Segmentation and Long Document Summarization Code
#11DeepPyramidion
47.15
ROUGE-1
No paper
#12DeepPyramidion
47.15
ROUGE-1
No paper
#13Blockwise(baseline)
46.85
ROUGE-1
No paper
#14HAT-BARTSOTA
46.74
ROUGE-1· Extra Data· 2021-04-15
Hierarchical Learning for Generation with Long Source Sequences
#15HiStruct+
45.22
ROUGE-1· 2022-03-17
HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Information
#16DANCER PEGASUSSOTA
45.01
ROUGE-1· Extra Data· 2020-04-13
A Divide-and-Conquer Approach to the Summarization of Long Documents Code
#17PEGASUSSOTA
44.67
ROUGE-1· Extra Data· 2019-12-18
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization Code
#18ExtSum-LG+RdLoss
44.01
ROUGE-1· 2020-11-30
Systematically Exploring Redundancy Reduction in Summarizing Long Documents Code
#19ExtSum-LG+MMR-Select+
43.87
ROUGE-1· 2020-11-30
Systematically Exploring Redundancy Reduction in Summarizing Long Documents Code
#20ExtSum-LGSOTA
43.58
ROUGE-1· 2019-09-17
Extractive Summarization of Long Documents by Combining Global and Local Context Code
#21SRformer-BART
42.99
ROUGE-1· 2023-05-24
Segmented Recurrent Transformer: An Efficient Sequence-to-Sequence Model Code
#22DANCER RUM
42.7
ROUGE-1· 2020-04-13
A Divide-and-Conquer Approach to the Summarization of Long Documents Code
#23TLM-I+ESOTA
42.43
ROUGE-1· 2019-09-07
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models Code
#24Sent-PTR
42.32
ROUGE-1· 2019-09-07
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models Code
#25DANCER LSTM
41.87
ROUGE-1· 2020-04-13
A Divide-and-Conquer Approach to the Summarization of Long Documents Code
#26GenCompareSum
39.96
ROUGE-1
No paperCode
#27DiscourseSOTA
35.8
ROUGE-1· 2018-04-16
A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents Code
#28Sent-CLF
34.01
ROUGE-1· 2019-09-07
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models Code
#29Pntr-Gen-Seq2SeqSOTA
32.06
ROUGE-1· 2017-04-14
Get To The Point: Summarization with Pointer-Generator Networks Code