Text Summarization on BookSum

Metric: ROUGE-2 (higher is better)

LeaderboardDataset
Loading chart...
#ModelROUGE-2Extra DataPaperDateCode
1Echoes-Extractive-Abstractive10.53NoEchoes from Alexandria: A Large Resource for Mul...2023-06-07Code
2NexusSum (Mistral Large)10.27NoNexusSum: Hierarchical LLM Agents for Long-Form ...2025-05-30-
3Zero-Shot (GPT-4o)3.5NoEnd-to-End Long Document Summarization using Gra...2025-01-03-
4Zero-Shot (Mistral Large)2.99NoNexusSum: Hierarchical LLM Agents for Long-Form ...2025-05-30-