Reranker

Reported on 4 benchmarks across 1 task

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

Code GenerationonCoNaLa-Ext
BLEU
19.85
best: 35.32 (BART W/ Mined)
Code GenerationonCoNaLa
BLEU
30.11
best: 44.32 (PanGu-Coder-FT-I)
Code GenerationonCoNaLa
Exact Match Accuracy
2.8
best: 13.8 (RoBERTaMarian)
Code GenerationonDjango
Accuracy
80.2
best: 81.83 (MarianCG)