TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Transformer + ASR Pretrain

Transformer + ASR Pretrain

Reported on 7 benchmarks across 1 task · 2 papers · 1 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

  • Speech-to-Text TranslationonMuST-C EN->DE
    Case-sensitive sacreBLEU· 2020-10-11
    22.7
    best: 28.88 (Task Modulation + Multitask Learning(ASR/MT) + Data Augmentation)
    SOTA
    fairseq S2T: Fast Speech-to-Text Modeling with fairseqarXiv:2010.05171
  • Speech-to-Text TranslationonMuST-C EN->FR
    Case-sensitive sacreBLEU· 2020-12-18
    32.3
    best: 33.45 (Dual-decoder Transformer)
    NeurST: Neural Speech Translation ToolkitarXiv:2012.10018
  • Speech-to-Text TranslationonMuST-C EN->DE
    Case-sensitive sacreBLEU· 2020-12-18
    22.8
    best: 28.88 (Task Modulation + Multitask Learning(ASR/MT) + Data Augmentation)
    NeurST: Neural Speech Translation ToolkitarXiv:2012.10018
  • Speech-to-Text Translationonlibri-trans
    Case-insensitive sacreBLEU· 2020-12-18
    16.5
    best: 17.2 (Transformer + ASR Pretrain + SpecAug)
    NeurST: Neural Speech Translation ToolkitarXiv:2012.10018
  • Speech-to-Text Translationonlibri-trans
    Case-insensitive tokenized BLEU· 2020-12-18
    17.9
    best: 18.7 (Transformer + ASR Pretrain + SpecAug)
    NeurST: Neural Speech Translation ToolkitarXiv:2012.10018
  • Speech-to-Text Translationonlibri-trans
    Case-sensitive sacreBLEU· 2020-12-18
    15.5
    best: 16.3 (Transformer + ASR Pretrain + SpecAug)
    NeurST: Neural Speech Translation ToolkitarXiv:2012.10018
  • Speech-to-Text Translationonlibri-trans
    Case-sensitive tokenized BLEU· 2020-12-18
    16.9
    best: 17.8 (Transformer + ASR Pretrain + SpecAug)
    NeurST: Neural Speech Translation ToolkitarXiv:2012.10018
  • Speech-to-Text TranslationonMuST-C EN->ES
    Case-sensitive sacreBLEU· 2020-12-18
    26.8
    best: 28.73 (Transformer with Adapters)
    NeurST: Neural Speech Translation ToolkitarXiv:2012.10018