DS-1000
TextsApache-2.0 licenseIntroduced 2022-11-18
DS-1000 is a code generation benchmark with a thousand data science questions spanning seven Python libraries that (1) reflects diverse, realistic, and practical use cases, (2) has a reliable metric, (3) defends against memorization by perturbing questions.
Source: DS-1000: A Natural and Reliable Benchmark for Data Science Code Generation
Image Source: https://arxiv.org/abs/2211.11501