Text Summarization on Pubmed

Metric: ROUGE-1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	ROUGE-1▼	Extra Data	Paper	Date↕	Code
1	Top Down Transformer (AdaPool) (464M)	51.05	No	Long Document Summarization with Top-down and Bo...	2022-03-15	Code
2	eyeglaxs	50.34	No	Scaling Up Summarization: Leveraging Large Langu...	2024-08-28	-
3	BART-LS	50.3	No	Adapting Pretrained Text-to-Text Models for Long...	2022-09-21	Code
4	LongT5	50.23	No	LongT5: Efficient Text-To-Text Transformer for L...	2021-12-15	Code
5	GoSum (extractive)	49.83	No	GoSum: Extractive Summarization of Long Document...	2022-11-18	Code
6	Lodoss-full-large (extractive)	49.38	No	Toward Unifying Text Segmentation and Long Docum...	2022-10-28	Code
7	MemSum (extractive)	49.25	No	MemSum: Extractive Summarization of Long Documen...	2021-07-19	Code
8	Lodoss-full-base (extractive)	48.93	No	Toward Unifying Text Segmentation and Long Docum...	2022-10-28	Code
9	HAT-BART	48.25	Yes	Hierarchical Learning for Generation with Long S...	2021-04-15	-
10	GRETEL	48.2	No	GRETEL: Graph Contrastive Topic Enhanced Languag...	2022-08-21	-
11	DeepPyramidion	47.81	No	Sparsifying Transformer Models with Trainable Re...	2020-09-10	Code
12	FactorSum	47.5	No	Factorizing Content and Budget Decisions in Abst...	2022-05-25	Code
13	HiStruct+	46.59	No	HiStruct+: Improving Extractive Text Summarizati...	2022-03-17	-
14	DANCER PEGASUS	46.34	Yes	A Divide-and-Conquer Approach to the Summarizati...	2020-04-13	Code
15	BigBird-Pegasus	46.32	Yes	Big Bird: Transformers for Longer Sequences	2020-07-28	Code
16	ExtSum-LG+MMR-Select+	45.39	No	Systematically Exploring Redundancy Reduction in...	2020-11-30	Code
17	ExtSum-LG+RdLoss	45.3	No	Systematically Exploring Redundancy Reduction in...	2020-11-30	Code
18	PEGASUS	45.09	Yes	PEGASUS: Pre-training with Extracted Gap-sentenc...	2019-12-18	Code
19	Sent-CLF	45.01	No	On Extractive and Abstractive Neural Document Su...	2019-09-07	Code
20	ExtSum-LG	44.81	No	Extractive Summarization of Long Documents by Co...	2019-09-17	Code
21	DANCER LSTM	44.09	No	A Divide-and-Conquer Approach to the Summarizati...	2020-04-13	Code
22	DANCER RUM	43.98	No	A Divide-and-Conquer Approach to the Summarizati...	2020-04-13	Code
23	Sent-PTR	43.3	No	On Extractive and Abstractive Neural Document Su...	2019-09-07	Code
24	GenCompareSum	42.1	No	-	-	Code
25	TLM-I+E	41.43	No	On Extractive and Abstractive Neural Document Su...	2019-09-07	Code
26	MatchSum (BERT-base)	41.21	No	Extractive Summarization as Text Matching	2020-04-19	Code
27	Discourse	38.93	No	A Discourse-Aware Attention Model for Abstractiv...	2018-04-16	Code
28	Fastformer	38.09	No	Fastformer: Additive Attention Can Be All You Need	2021-08-20	Code
29	Pntr-Gen-Seq2Seq	35.86	No	Get To The Point: Summarization with Pointer-Gen...	2017-04-14	Code

#1Top Down Transformer (AdaPool) (464M)SOTA
51.05
ROUGE-1· 2022-03-15
Long Document Summarization with Top-down and Bottom-up Inference Code
#2eyeglaxs
50.34
ROUGE-1· 2024-08-28
Scaling Up Summarization: Leveraging Large Language Models for Long Text Extractive Summarization
#3BART-LS
50.3
ROUGE-1· 2022-09-21
Adapting Pretrained Text-to-Text Models for Long Text Sequences Code
#4LongT5SOTA
50.23
ROUGE-1· 2021-12-15
LongT5: Efficient Text-To-Text Transformer for Long Sequences Code
#5GoSum (extractive)
49.83
ROUGE-1· 2022-11-18
GoSum: Extractive Summarization of Long Documents by Reinforcement Learning and Graph Organized discourse state Code
#6Lodoss-full-large (extractive)
49.38
ROUGE-1· 2022-10-28
Toward Unifying Text Segmentation and Long Document Summarization Code
#7MemSum (extractive)SOTA
49.25
ROUGE-1· 2021-07-19
MemSum: Extractive Summarization of Long Documents Using Multi-Step Episodic Markov Decision Processes Code
#8Lodoss-full-base (extractive)
48.93
ROUGE-1· 2022-10-28
Toward Unifying Text Segmentation and Long Document Summarization Code
#9HAT-BARTSOTA
48.25
ROUGE-1· Extra Data· 2021-04-15
Hierarchical Learning for Generation with Long Source Sequences
#10GRETEL
48.2
ROUGE-1· 2022-08-21
GRETEL: Graph Contrastive Topic Enhanced Language Model for Long Document Extractive Summarization
#11DeepPyramidionSOTA
47.81
ROUGE-1· 2020-09-10
Sparsifying Transformer Models with Trainable Representation Pooling Code
#12FactorSum
47.5
ROUGE-1· 2022-05-25
Factorizing Content and Budget Decisions in Abstractive Summarization of Long Documents Code
#13HiStruct+
46.59
ROUGE-1· 2022-03-17
HiStruct+: Improving Extractive Text Summarization with Hierarchical Structure Information
#14DANCER PEGASUSSOTA
46.34
ROUGE-1· Extra Data· 2020-04-13
A Divide-and-Conquer Approach to the Summarization of Long Documents Code
#15BigBird-Pegasus
46.32
ROUGE-1· Extra Data· 2020-07-28
Big Bird: Transformers for Longer Sequences Code
#16ExtSum-LG+MMR-Select+
45.39
ROUGE-1· 2020-11-30
Systematically Exploring Redundancy Reduction in Summarizing Long Documents Code
#17ExtSum-LG+RdLoss
45.3
ROUGE-1· 2020-11-30
Systematically Exploring Redundancy Reduction in Summarizing Long Documents Code
#18PEGASUSSOTA
45.09
ROUGE-1· Extra Data· 2019-12-18
PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarization Code
#19Sent-CLFSOTA
45.01
ROUGE-1· 2019-09-07
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models Code
#20ExtSum-LG
44.81
ROUGE-1· 2019-09-17
Extractive Summarization of Long Documents by Combining Global and Local Context Code
#21DANCER LSTM
44.09
ROUGE-1· 2020-04-13
A Divide-and-Conquer Approach to the Summarization of Long Documents Code
#22DANCER RUM
43.98
ROUGE-1· 2020-04-13
A Divide-and-Conquer Approach to the Summarization of Long Documents Code
#23Sent-PTR
43.3
ROUGE-1· 2019-09-07
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models Code
#24GenCompareSum
42.1
ROUGE-1
No paperCode
#25TLM-I+E
41.43
ROUGE-1· 2019-09-07
On Extractive and Abstractive Neural Document Summarization with Transformer Language Models Code
#26MatchSum (BERT-base)
41.21
ROUGE-1· 2020-04-19
Extractive Summarization as Text Matching Code
#27DiscourseSOTA
38.93
ROUGE-1· 2018-04-16
A Discourse-Aware Attention Model for Abstractive Summarization of Long Documents Code
#28Fastformer
38.09
ROUGE-1· 2021-08-20
Fastformer: Additive Attention Can Be All You Need Code
#29Pntr-Gen-Seq2SeqSOTA
35.86
ROUGE-1· 2017-04-14
Get To The Point: Summarization with Pointer-Generator Networks Code