DEplain-web-sent

TextsCC-BY-SA-3; CC-BY-4; CC-BY-NC-ND-4Introduced 2023-05-30

DEplain-web-sent: A German Parallel Corpus for Sentence Simplification on Web Texts

DEplain is a new dataset of parallel, professionally written and manually aligned simplifications in plain German “plain DE” (or in German: “Einfache Sprache”). DEplain consists of four main subcorpora: DEplain-APA-doc, DEplain-APA-sent, DEplain-web-doc, and DEplain-web-sent.

DEplain-web-sent consists of approx. 150 aligned documents and approx. 2k manually aligned sentence pairs. The data is publicly available (see licenses). The corpus include texts from the following domains: fictional texts (literature and fairy tales), bible texts, health-related texts, and texts for language learners. The corpus can be used for German text simplification, or in more detail sentence simplification. The corpus is also available on Huggingface: https://huggingface.co/datasets/DEplain/DEplain-web-sent.