Transformer + R-Drop

Reported on 3 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing3 results

Machine TranslationonIWSLT2014 German-English
BLEU score· 2021-06-28
37.25
best: 40.43 (PiNMT)
R-Drop: Regularized Dropout for Neural Networks arXiv:2106.14448
Machine TranslationonWMT2014 English-German
BLEU score· 2021-06-28
30.91
best: 35.14 (Transformer Cycle (Rev))
R-Drop: Regularized Dropout for Neural Networks arXiv:2106.14448
Machine TranslationonWMT2014 English-French
BLEU score· 2021-06-28
43.95
best: 46.4 (Transformer+BT (ADMIN init))
R-Drop: Regularized Dropout for Neural Networks arXiv:2106.14448