TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Making Science Simple: Corpora for the Lay Summarisation o...

Making Science Simple: Corpora for the Lay Summarisation of Scientific Literature

Tomas Goldsack, Zhihao Zhang, Chenghua Lin, Carolina Scarton

2022-10-18Lay SummarizationScientific Document Summarization
PaperPDFCode(official)

Abstract

Lay summarisation aims to jointly summarise and simplify a given text, thus making its content more comprehensible to non-experts. Automatic approaches for lay summarisation can provide significant value in broadening access to scientific literature, enabling a greater degree of both interdisciplinary knowledge sharing and public understanding when it comes to research findings. However, current corpora for this task are limited in their size and scope, hindering the development of broadly applicable data-driven approaches. Aiming to rectify these issues, we present two novel lay summarisation datasets, PLOS (large-scale) and eLife (medium-scale), each of which contains biomedical journal articles alongside expert-written lay summaries. We provide a thorough characterisation of our lay summaries, highlighting differing levels of readability and abstractiveness between datasets that can be leveraged to support the needs of different applications. Finally, we benchmark our datasets using mainstream summarisation approaches and perform a manual evaluation with domain experts, demonstrating their utility and casting light on the key challenges of this task.

Results

TaskDatasetMetricValueModel
Text SummarizationeLifeROUGE-146.57BART
Text SummarizationeLifeROUGE-211.65BART
Text SummarizationeLifeROUGE-L43.7BART
Text SummarizationPLOSROUGE-142.35BART
Text SummarizationPLOSROUGE-212.96BART
Text SummarizationPLOSROUGE-L38.57BART
Scientific Document SummarizationeLifeROUGE-146.57BART
Scientific Document SummarizationeLifeROUGE-211.65BART
Scientific Document SummarizationeLifeROUGE-L43.7BART
Scientific Document SummarizationPLOSROUGE-142.35BART
Scientific Document SummarizationPLOSROUGE-212.96BART
Scientific Document SummarizationPLOSROUGE-L38.57BART

Related Papers

Explanatory Summarization with Discourse-Driven Planning2025-04-27CCSBench: Evaluating Compositional Controllability in LLMs for Scientific Document Summarization2024-10-16BioLay_AK_SS at BioLaySumm: Domain Adaptation by Two-Stage Fine-Tuning of Large Language Models used for Biomedical Lay Summary Generation2024-08-16Overview of the BioLaySumm 2024 Shared Task on the Lay Summarization of Biomedical Research Articles2024-08-16WisPerMed at BioLaySumm: Adapting Autoregressive Large Language Models for Lay Summarization of Scientific Articles2024-05-20Hierarchical Attention Graph for Scientific Document Summarization in Global and Local Level2024-05-16Generating Summaries with Controllable Readability Levels2023-10-16Overview of the BioLaySumm 2023 Shared Task on Lay Summarization of Biomedical Research Articles2023-09-29