Shashi Narayan, Shay B. Cohen, Mirella Lapata
Single document summarization is the task of producing a shorter version of a document while preserving its principal information content. In this paper we conceptualize extractive summarization as a sentence ranking task and propose a novel training algorithm which globally optimizes the ROUGE evaluation metric through a reinforcement learning objective. We use our algorithm to train a neural summarization model on the CNN and DailyMail datasets and demonstrate experimentally that it outperforms state-of-the-art extractive and abstractive systems when evaluated automatically and by humans.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Text Summarization | CNN / Daily Mail | ROUGE-1 | 40 | REFRESH |
| Text Summarization | CNN / Daily Mail | ROUGE-2 | 18.2 | REFRESH |
| Text Summarization | CNN / Daily Mail | ROUGE-L | 36.6 | REFRESH |
| Extractive Text Summarization | CNN / Daily Mail | ROUGE-1 | 40 | REFRESH |
| Extractive Text Summarization | CNN / Daily Mail | ROUGE-2 | 18.2 | REFRESH |
| Extractive Text Summarization | CNN / Daily Mail | ROUGE-L | 36.6 | REFRESH |