SLING
Sino LINGuistics
TextsMIT LicenseIntroduced 2022-10-21
SLING consists of 38K minimal sentence pairs in Mandarin Chinese grouped into 9 high-level linguistic phenomena. Each pair demonstrates the acceptability contrast of a specific syntactic or semantic phenomenon (e.g., The keys are lost vs. The keys is lost), and an LM should assign lower perplexity to the acceptable sentence.
Source: SLING: Sino Linguistic Evaluation of Large Language Models
Image Source: https://arxiv.org/pdf/2210.11689v1.pdf