Code Generation on CoNaLa-Ext

Metric: BLEU (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	BLEU▼	Extra Data	Paper	Date↕	Code
1	BART W/ Mined	35.32	No	Reading StackOverflow Encourages Cheating: Addin...	2021-06-08	Code
2	BART Base	34.35	No	Reading StackOverflow Encourages Cheating: Addin...	2021-06-08	Code
3	External Knowledge With API + Reranking	20.54	No	Incorporating External Knowledge through Pre-tra...	2020-04-20	Code
4	External Knowledge With API	20.37	No	Incorporating External Knowledge through Pre-tra...	2020-04-20	Code
5	Reranker	19.85	No	-	-	-
6	TranX	18.85	No	TRANX: A Transition-based Neural Abstract Syntax...	2018-10-05	Code

#1BART W/ MinedSOTA
35.32
BLEU· 2021-06-08
Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation Code
#2BART Base
34.35
BLEU· 2021-06-08
Reading StackOverflow Encourages Cheating: Adding Question Text Improves Extractive Code Generation Code
#3External Knowledge With API + RerankingSOTA
20.54
BLEU· 2020-04-20
Incorporating External Knowledge through Pre-training for Natural Language to Code Generation Code
#4External Knowledge With API
20.37
BLEU· 2020-04-20
Incorporating External Knowledge through Pre-training for Natural Language to Code Generation Code
#5Reranker
19.85
BLEU
No paper
#6TranXSOTA
18.85
BLEU· 2018-10-05
TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation Code