TransformerBase + AutoDropout

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Machine TranslationonIWSLT2014 German-English
BLEU score· 2021-01-05
35.8
best: 40.43 (PiNMT)
AutoDropout: Learning Dropout Patterns to Regularize Deep Networks arXiv:2101.01761
Machine TranslationonWMT2014 English-French
BLEU score· 2021-01-05
40
best: 46.4 (Transformer+BT (ADMIN init))
AutoDropout: Learning Dropout Patterns to Regularize Deep Networks arXiv:2101.01761