RepoCoder
Reported on 5 benchmarks across 1 task · 1 paper · 5 SOTA
Note: results are matched by exact model name. Different papers may use the same name for different model variants.
Computer Code5 results
- BLEU· 2023-03-22SOTA63.52best: 66.29 (Rambo)
- Compilation Rate· 2023-03-22SOTA74.02best: 76.47 (Rambo)
- Pass@1· 2023-03-22SOTA59.8best: 63.73 (Rambo)
- BLEU· 2023-03-22SOTA46.22best: 50.44 (Rambo)
- Compilation Rate· 2023-03-22SOTA58.09best: 61.7 (Rambo)