Document Summarization on HowSumm-Step

Metric: ROUGE-1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	ROUGE-1▼	Extra Data	Paper	Date↕	Code
1	LexRank (query: step title)	39.6	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code
2	CES (query: step title)	39.3	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code
3	CES (query: step + method titles)	38.3	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code
4	LexRank (query: step + method titles)	38.2	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code
5	CES (query: step + method + article titles)	37	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code
6	LexRank (query: step + method + article titles)	36.3	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code
7	GreedyRel (query: step + method titles)	30.3	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code
8	GreedyRel (query: step title)	30.1	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code
9	BM25-HierSumm (query: step + method titles)	23	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code
10	BM25-HierSumm (query: step title)	22.3	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code
11	BM25-HierSumm (query: step + method + article titles)	21.9	No	HowSumm: A Multi-Document Summarization Dataset ...	2021-10-07	Code

#1LexRank (query: step title)SOTA
39.6
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code
#2CES (query: step title)
39.3
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code
#3CES (query: step + method titles)
38.3
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code
#4LexRank (query: step + method titles)
38.2
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code
#5CES (query: step + method + article titles)
37
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code
#6LexRank (query: step + method + article titles)
36.3
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code
#7GreedyRel (query: step + method titles)
30.3
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code
#8GreedyRel (query: step title)
30.1
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code
#9BM25-HierSumm (query: step + method titles)
23
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code
#10BM25-HierSumm (query: step title)
22.3
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code
#11BM25-HierSumm (query: step + method + article titles)
21.9
ROUGE-1· 2021-10-07
HowSumm: A Multi-Document Summarization Dataset Derived from WikiHow Articles Code