Program Synthesis

14 benchmarks423 papers

Program synthesis is the process of automatically generating a program or code snippet that satisfies a given specification or set of requirements. This can include generating code from a formal specification, a natural language description, or example inputs and outputs. The primary goal of program synthesis is to minimize human intervention in the coding process, reduce errors, and improve productivity.

Program synthesis often involves the use of advanced algorithms, artificial intelligence, and machine learning techniques to search the space of possible programs that meet the given constraints. This process can be guided by a variety of techniques, such as constraint solving, symbolic execution, and genetic algorithms.

Benchmarks

Program Synthesis on DeepFix

Program Synthesis on GitHub-Python

Program Synthesis on Py150

Program Synthesis on AlgoLisp

Program Synthesis on DeepTyper

Program Synthesis on HumanEvalPack