Machine Translation on ACES

Metric: Score (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Score▼	Extra Data	Paper	Date↕	Code
1	HWTSC-Teacher-Sim	19.97	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
2	MS-COMET-22	19.89	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
3	MS-COMET-QE-22	19.76	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
4	KG-BERTScore	17.28	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
5	metricx_xl_DA_2019	17.17	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
6	COMET-QE	16.8	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
7	COMET-22	16.31	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
8	UniTE-src	15.68	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
9	UniTE-ref	15.38	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
10	metricx_xxl_DA_2019	15.24	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
11	UniTE	14.76	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
12	Cross-QE	14.07	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
13	chrF	13.57	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
14	metricx_xl_MQM_2020	13.08	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
15	COMET-20	12.06	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
16	BLEURT-20	11.9	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
17	YiSi-1	11.38	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
18	BERTScore	10.47	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
19	f200spBLEU	-0.18	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
20	f101spBLEU	-0.33	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code
21	BLEU	-3.13	No	ACES: Translation Accuracy Challenge Sets for Ev...	2022-10-27	Code

#1HWTSC-Teacher-SimSOTA
19.97
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#2MS-COMET-22
19.89
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#3MS-COMET-QE-22
19.76
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#4KG-BERTScore
17.28
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#5metricx_xl_DA_2019
17.17
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#6COMET-QE
16.8
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#7COMET-22
16.31
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#8UniTE-src
15.68
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#9UniTE-ref
15.38
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#10metricx_xxl_DA_2019
15.24
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#11UniTE
14.76
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#12Cross-QE
14.07
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#13chrF
13.57
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#14metricx_xl_MQM_2020
13.08
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#15COMET-20
12.06
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#16BLEURT-20
11.9
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#17YiSi-1
11.38
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#18BERTScore
10.47
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#19f200spBLEU
-0.18
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#20f101spBLEU
-0.33
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code
#21BLEU
-3.13
Score· 2022-10-27
ACES: Translation Accuracy Challenge Sets for Evaluating Machine Translation Metrics Code