Machine Translation on WMT2016 English-Romanian

Metric: BLEU score (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	BLEU score▼	Extra Data	Paper	Date↕	Code
1	DeLighT	34.7	No	DeLighT: Deep and Light-weight Transformer	2020-08-03	Code
2	CMLM+LAT+4 iterations	32.87	No	Incorporating a Local Translation Mechanism into...	2020-11-12	Code
3	FlowSeq-large (NPD n = 30)	32.35	No	FlowSeq: Non-Autoregressive Conditional Sequence...	2019-09-05	Code
4	FlowSeq-large (NPD n=15)	31.97	No	FlowSeq: Non-Autoregressive Conditional Sequence...	2019-09-05	Code
5	FlowSeq-large (IWD n = 15)	31.08	No	FlowSeq: Non-Autoregressive Conditional Sequence...	2019-09-05	Code
6	CMLM+LAT+1 iterations	30.74	No	Incorporating a Local Translation Mechanism into...	2020-11-12	Code
7	ConvS2S BPE40k	29.9	No	Convolutional Sequence to Sequence Learning	2017-05-08	Code
8	FlowSeq-large	29.86	No	FlowSeq: Non-Autoregressive Conditional Sequence...	2019-09-05	Code
9	NAT +FT + NPD	29.79	No	Non-Autoregressive Neural Machine Translation	2017-11-07	Code
10	Denoising autoencoders (non-autoregressive)	29.66	No	Deterministic Non-Autoregressive Neural Sequence...	2018-02-19	Code
11	FlowSeq-base	29.26	No	FlowSeq: Non-Autoregressive Conditional Sequence...	2019-09-05	Code
12	GRU BPE90k	28.9	No	-	-	-
13	BiGRU	28.1	No	Edinburgh Neural Machine Translation Systems for...	2016-06-09	Code
14	Deep Convolutional Encoder; single-layer decoder	27.8	No	A Convolutional Encoder Model for Neural Machine...	2016-11-07	Code
15	BiLSTM	27.5	No	A Convolutional Encoder Model for Neural Machine...	2016-11-07	Code
16	PBSMT + NMT	25.13	No	Phrase-Based & Neural Unsupervised Machine Trans...	2018-04-20	Code
17	Unsupervised PBSMT	21.33	No	Phrase-Based & Neural Unsupervised Machine Trans...	2018-04-20	Code
18	Unsupervised NMT + Transformer	21.18	No	Phrase-Based & Neural Unsupervised Machine Trans...	2018-04-20	Code
19	FLAN 137B (few-shot, k=9)	20.5	No	Finetuned Language Models Are Zero-Shot Learners	2021-09-03	Code
20	FLAN 137B (zero-shot)	18.9	No	Finetuned Language Models Are Zero-Shot Learners	2021-09-03	Code

#1DeLighTSOTA
34.7
BLEU score· 2020-08-03
DeLighT: Deep and Light-weight Transformer Code
#2CMLM+LAT+4 iterations
32.87
BLEU score· 2020-11-12
Incorporating a Local Translation Mechanism into Non-autoregressive Translation Code
#3FlowSeq-large (NPD n = 30)SOTA
32.35
BLEU score· 2019-09-05
FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow Code
#4FlowSeq-large (NPD n=15)
31.97
BLEU score· 2019-09-05
FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow Code
#5FlowSeq-large (IWD n = 15)
31.08
BLEU score· 2019-09-05
FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow Code
#6CMLM+LAT+1 iterations
30.74
BLEU score· 2020-11-12
Incorporating a Local Translation Mechanism into Non-autoregressive Translation Code
#7ConvS2S BPE40kSOTA
29.9
BLEU score· 2017-05-08
Convolutional Sequence to Sequence Learning Code
#8FlowSeq-large
29.86
BLEU score· 2019-09-05
FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow Code
#9NAT +FT + NPD
29.79
BLEU score· 2017-11-07
Non-Autoregressive Neural Machine Translation Code
#10Denoising autoencoders (non-autoregressive)
29.66
BLEU score· 2018-02-19
Deterministic Non-Autoregressive Neural Sequence Modeling by Iterative Refinement Code
#11FlowSeq-base
29.26
BLEU score· 2019-09-05
FlowSeq: Non-Autoregressive Conditional Sequence Generation with Generative Flow Code
#12GRU BPE90k
28.9
BLEU score
No paper
#13BiGRUSOTA
28.1
BLEU score· 2016-06-09
Edinburgh Neural Machine Translation Systems for WMT 16 Code
#14Deep Convolutional Encoder; single-layer decoder
27.8
BLEU score· 2016-11-07
A Convolutional Encoder Model for Neural Machine Translation Code
#15BiLSTM
27.5
BLEU score· 2016-11-07
A Convolutional Encoder Model for Neural Machine Translation Code
#16PBSMT + NMT
25.13
BLEU score· 2018-04-20
Phrase-Based & Neural Unsupervised Machine Translation Code
#17Unsupervised PBSMT
21.33
BLEU score· 2018-04-20
Phrase-Based & Neural Unsupervised Machine Translation Code
#18Unsupervised NMT + Transformer
21.18
BLEU score· 2018-04-20
Phrase-Based & Neural Unsupervised Machine Translation Code
#19FLAN 137B (few-shot, k=9)
20.5
BLEU score· 2021-09-03
Finetuned Language Models Are Zero-Shot Learners Code
#20FLAN 137B (zero-shot)
18.9
BLEU score· 2021-09-03
Finetuned Language Models Are Zero-Shot Learners Code