Program Synthesis on ManyTypes4TypeScript

Metric: Average Recall (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Average Recall▼	Extra Data	Paper	Date↕	Code
1	GraphCodeBERT	61.08	No	GraphCodeBERT: Pre-training Code Representations...	2020-09-17	Code
2	CodeBERT	59.8	No	CodeBERT: A Pre-Trained Model for Programming an...	2020-02-19	Code
3	PolyGot	58.91	No	Multilingual training for Software Engineering	2021-12-03	-
4	GraphPolyGot	58.91	No	Multilingual training for Software Engineering	2021-12-03	-
5	RoBERTa	57.62	No	RoBERTa: A Robustly Optimized BERT Pretraining A...	2019-07-26	Code
6	CodeBERTa	56.85	No	-	-	-
7	BERT	54.02	No	BERT: Pre-training of Deep Bidirectional Transfo...	2018-10-11	Code

#1GraphCodeBERTSOTA
61.08
Average Recall· 2020-09-17
GraphCodeBERT: Pre-training Code Representations with Data Flow Code
#2CodeBERTSOTA
59.8
Average Recall· 2020-02-19
CodeBERT: A Pre-Trained Model for Programming and Natural Languages Code
#3PolyGot
58.91
Average Recall· 2021-12-03
Multilingual training for Software Engineering
#4GraphPolyGot
58.91
Average Recall· 2021-12-03
Multilingual training for Software Engineering
#5RoBERTaSOTA
57.62
Average Recall· 2019-07-26
RoBERTa: A Robustly Optimized BERT Pretraining Approach Code
#6CodeBERTa
56.85
Average Recall
No paper
#7BERTSOTA
54.02
Average Recall· 2018-10-11
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding Code