TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/MLM pretraining for encoder and decoder

MLM pretraining for encoder and decoder

Reported on 7 benchmarks across 1 task · 1 paper · 7 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing7 results

  • Machine TranslationonWMT2014 English-French
    BLEU· 2019-01-22
    33.4
    best: 38.27 (BERT-fused NMT)
    SOTA
    Cross-lingual Language Model PretrainingarXiv:1901.07291
  • Machine TranslationonWMT2014 French-English
    BLEU· 2019-01-22
    33.3
    best: 39.2 (GPT-3 175B (Few-Shot))
    SOTA
    Cross-lingual Language Model PretrainingarXiv:1901.07291
  • Machine TranslationonWMT2016 English-German
    BLEU· 2019-01-22
    26.4
    best: 29.7 (GPT-3 175B (Few-Shot))
    SOTA
    Cross-lingual Language Model PretrainingarXiv:1901.07291
  • Machine TranslationonWMT2016 English--Romanian
    BLEU· 2019-01-22
    33.3
    best: 36.02 (BERT-fused NMT)
    SOTA
    Cross-lingual Language Model PretrainingarXiv:1901.07291
  • Machine TranslationonWMT2016 Romanian-English
    BLEU· 2019-01-22
    31.8
    best: 39.5 (GPT-3 175B (Few-Shot))
    SOTA
    Cross-lingual Language Model PretrainingarXiv:1901.07291
  • Machine TranslationonWMT2016 German-English
    BLEU· 2019-01-22
    34.3
    best: 40.6 (GPT-3 175B (Few-Shot))
    SOTA
    Cross-lingual Language Model PretrainingarXiv:1901.07291
  • Machine TranslationonWMT2016 English-Romanian
    BLEU· 2019-01-22
    33.3
    best: 35.2 (MASS (6-layer Transformer))
    SOTA
    Cross-lingual Language Model PretrainingarXiv:1901.07291