Code Completion

20 benchmarks212 papers

Benchmarks

Code Completion on SAFIM

Average Algorithmic Control API

Code Completion on OpenAPI completion refined

Correctness, avg., %Correctness, max., %Validness, avg., %Validness, max., %

Code Completion on CodeXGLUE - Github Java Corpus

EM (line-level)Edit Sim (line-level)Accuracy (token-level)

Code Completion on CodeXGLUE - PY150

EM (line-level)Edit Sim (line-level)Accuracy (token-level)

Code Completion on DotPrompts

Compilation Rate

Code Completion on Defects4J

Compilation Rate Pass@1 BLEU

Code Completion on Rambo Benchmark

Compilation Rate BLEU