Machine Translation on ACES

Metric: Score (higher is better)

LeaderboardDataset

Loading chart...

Results

#	Model↕	Score▼	Extra Data	Paper	Date↕	Code
1	HWTSC-Teacher-Sim	19.97	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
2	MS-COMET-22	19.89	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
3	MS-COMET-QE-22	19.76	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
4	KG-BERTScore	17.28	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
5	metricx_xl_DA_2019	17.17	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
6	COMET-QE	16.8	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
7	COMET-22	16.31	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
8	UniTE-src	15.68	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
9	UniTE-ref	15.38	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
10	metricx_xxl_DA_2019	15.24	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
11	UniTE	14.76	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
12	Cross-QE	14.07	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
13	chrF	13.57	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
14	metricx_xl_MQM_2020	13.08	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
15	COMET-20	12.06	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
16	BLEURT-20	11.9	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
17	YiSi-1	11.38	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
18	BERTScore	10.47	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
19	f200spBLEU	-0.18	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
20	f101spBLEU	-0.33	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
21	BLEU	-3.13	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code