TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/SeamlessM4T Medium

SeamlessM4T Medium

Reported on 8 benchmarks across 3 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing6 results

  • Machine Translationonflores95-devtest X-eng
    ChrF++· 2023-08-22
    55.4
    best: 60.8 (SeamlessM4T Large)
    SeamlessM4T: Massively Multilingual & Multimodal Machine TranslationarXiv:2308.11596
  • Machine Translationonflores95-devtest eng-X
    ChrF++· 2023-08-22
    48.4
    best: 50.9 (SeamlessM4T Large)
    SeamlessM4T: Massively Multilingual & Multimodal Machine TranslationarXiv:2308.11596
  • Speech-to-Text TranslationonFLEURS X-eng
    BLEU· 2023-08-22
    20.9
    best: 24 (SeamlessM4T Large)
    SeamlessM4T: Massively Multilingual & Multimodal Machine TranslationarXiv:2308.11596
  • Speech-to-Text TranslationonFLEURS eng-X
    BLEU· 2023-08-22
    19.2
    best: 21.5 (SeamlessM4T Large)
    SeamlessM4T: Massively Multilingual & Multimodal Machine TranslationarXiv:2308.11596
  • Speech-to-Text TranslationonCoVoST 2 X-eng
    BLEU· 2023-08-22
    29.8
    best: 34.1 (SeamlessM4T Large)
    SeamlessM4T: Massively Multilingual & Multimodal Machine TranslationarXiv:2308.11596
  • Speech-to-Text TranslationonCoVoST 2 eng-X
    BLEU· 2023-08-22
    26.6
    best: 30.6 (SeamlessM4T Large)
    SeamlessM4T: Massively Multilingual & Multimodal Machine TranslationarXiv:2308.11596

Speech2 results

  • Speech-to-Speech TranslationonFLEURS X-eng
    ASR-BLEU· 2023-08-22
    20.4
    best: 32.3 (GenTranslateV2)
    SeamlessM4T: Massively Multilingual & Multimodal Machine TranslationarXiv:2308.11596
  • Speech-to-Speech TranslationonCVSS
    ASR-BLEU· 2023-08-22
    28.1
    best: 36.5 (SeamlessM4T Large)
    SeamlessM4T: Massively Multilingual & Multimodal Machine TranslationarXiv:2308.11596