Text Summarization on Pubmed

Metric: ROUGE-2 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	ROUGE-2▼	Extra Data	Paper	Date↕	Code
1	LongT5	24.76	No	LongT5: Efficient Text-To-Text Transformer for L...	2021-12-15	Code
2	eyeglaxs	24.57	No	Scaling Up Summarization: Leveraging Large Langu...	2024-08-28	-
3	Lodoss-full-large (extractive)	23.89	No	Toward Unifying Text Segmentation and Long Docum...	2022-10-28	Code
4	GoSum (extractive)	23.56	No	GoSum: Extractive Summarization of Long Document...	2022-11-18	Code
5	Lodoss-full-base (extractive)	23.51	No	Toward Unifying Text Segmentation and Long Docum...	2022-10-28	Code
6	Top Down Transformer (AdaPool) (464M)	23.26	No	Long Document Summarization with Top-down and Bo...	2022-03-15	Code
7	MemSum (extractive)	22.94	No	MemSum: Extractive Summarization of Long Documen...	2021-07-19	Code
8	HAT-BART	21.35	Yes	Hierarchical Learning for Generation with Long S...	2021-04-15	-
9	GRETEL	21.2	No	GRETEL: Graph Contrastive Topic Enhanced Languag...	2022-08-21	-
10	DeepPyramidion	21.14	No	Sparsifying Transformer Models with Trainable Re...	2020-09-10	Code
11	BigBird-Pegasus	20.65	Yes	Big Bird: Transformers for Longer Sequences	2020-07-28	Code
12	ExtSum-LG+RdLoss	20.42	No	Systematically Exploring Redundancy Reduction in...	2020-11-30	Code
13	HiStruct+	20.39	No	HiStruct+: Improving Extractive Text Summarizati...	2022-03-17	-
14	ExtSum-LG+MMR-Select+	20.37	No	Systematically Exploring Redundancy Reduction in...	2020-11-30	Code
15	FactorSum	20.33	No	Factorizing Content and Budget Decisions in Abst...	2022-05-25	Code
16	DANCER PEGASUS	19.97	Yes	A Divide-and-Conquer Approach to the Summarizati...	2020-04-13	Code
17	ExtSum-LG	19.74	No	Extractive Summarization of Long Documents by Co...	2019-09-17	Code
18	DANCER LSTM	17.69	No	A Divide-and-Conquer Approach to the Summarizati...	2020-04-13	Code
19	DANCER RUM	17.65	No	A Divide-and-Conquer Approach to the Summarizati...	2020-04-13	Code
20	GenCompareSum	16.51	No	-	-	Code
21	Fastformer	15.44	No	Fastformer: Additive Attention Can Be All You Need	2021-08-20	Code
22	MatchSum (BERT-base)	14.91	No	Extractive Summarization as Text Matching	2020-04-19	Code

#1LongT5SOTA
24.76
ROUGE-2· 2021-12-15
LongT5: Efficient Text-To-Text Transformer for Long Sequences Code
#2eyeglaxs
24.57
ROUGE-2· 2024-08-28
Scaling Up Summarization: Leveraging Large Language Models for Long Text Extractive Summarization
#3Lodoss-full-large (extractive)
23.89
ROUGE-2· 2022-10-28
Toward Unifying Text Segmentation and Long Document Summarization Code
#4GoSum (extractive)
23.56
ROUGE-2· 2022-11-18
GoSum: Extractive Summarization of Long Documents by Reinforcement Learning and Graph Organized discourse state Code
#5Lodoss-full-base (extractive)
23.51
ROUGE-2· 2022-10-28
Toward Unifying Text Segmentation and Long Document Summarization Code
#6Top Down Transformer (AdaPool) (464M)
23.26
ROUGE-2· 2022-03-15
Long Document Summarization with Top-down and Bottom-up Inference Code
#7MemSum (extractive)SOTA
22.94
ROUGE-2· 2021-07-19
MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processes Code
#8HAT-BARTSOTA
21.35
ROUGE-2· Extra Data· 2021-04-15
Hierarchical Learning for Generation with Long Source Sequences
#9GRETEL
21.2
ROUGE-2· 2022-08-21
GRETEL: Graph Contrastive Topic Enhanced Language Model for Long Document Extractive Summarization
#10DeepPyramidionSOTA
21.14
ROUGE-2· 2020-09-10
Sparsifying Transformer Models with Trainable Representation Pooling Code
#11BigBird-PegasusSOTA
20.65
ROUGE-2· Extra Data· 2020-07-28
Big Bird: Transformers for Longer Sequences Code
#12ExtSum-LG+RdLoss
20.42
ROUGE-2· 2020-11-30
Systematically Exploring Redundancy Reduction in Summarizing Long Documents Code
#13HiStruct+
20.39
ROUGE-2· 2022-03-17
HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Information
#14ExtSum-LG+MMR-Select+
20.37
ROUGE-2· 2020-11-30
Systematically Exploring Redundancy Reduction in Summarizing Long Documents Code
#15FactorSum
20.33
ROUGE-2· 2022-05-25
Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documents Code
#16DANCER PEGASUSSOTA
19.97
ROUGE-2· Extra Data· 2020-04-13
A Divide-and-Conquer Approach to the Summarization of Long Documents Code
#17ExtSum-LGSOTA
19.74
ROUGE-2· 2019-09-17
Extractive Summarization of Long Documents by Combining Global and Local Context Code
#18DANCER LSTM
17.69
ROUGE-2· 2020-04-13
A Divide-and-Conquer Approach to the Summarization of Long Documents Code
#19DANCER RUM
17.65
ROUGE-2· 2020-04-13
A Divide-and-Conquer Approach to the Summarization of Long Documents Code
#20GenCompareSum
16.51
ROUGE-2
No paperCode
#21Fastformer
15.44
ROUGE-2· 2021-08-20
Fastformer: Additive Attention Can Be All You Need Code
#22MatchSum (BERT-base)
14.91
ROUGE-2· 2020-04-19
Extractive Summarization as Text Matching Code