TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Natural Language Processing/Machine Translation

Machine Translation

126 benchmarks10752 papers

Machine translation is the task of translating a sentence in a source language to a different target language.

Approaches for machine translation can range from rule-based to statistical to neural-based. More recently, encoder-decoder attention-based architectures like BERT have attained major improvements in machine translation.

One of the most popular datasets used to benchmark machine translation systems is the WMT family of datasets. Some of the most commonly used evaluation metrics for machine translation systems include BLEU, METEOR, NIST, and others.

<span style="color:grey; opacity: 0.6">( Image credit: Google seq2seq )</span>

Benchmarks

Machine Translation on WMT2014 English-German

BLEU scoreSacreBLEUBLEUNumber of ParamsHardware BurdenOperations per network pass

Machine Translation on WMT2014 English-French

BLEU scoreBLEUSacreBLEUHardware BurdenOperations per network pass

Machine Translation on IWSLT2014 German-English

BLEU scoreNumber of Params

Machine Translation on ACES

Score

Machine Translation on WMT2016 English-Romanian

BLEU scoreBLEUBLEU-4

Machine Translation on WMT2016 Romanian-English

BLEU scoreBLEUBLEU-4

Machine Translation on WMT2014 German-English

BLEU scoreBLEU

Machine Translation on IWSLT2015 German-English

BLEU score

Machine Translation on Multi30K

BLEU (EN-DE)Meteor (EN-DE)Meteor (EN-FR)BLUE (DE-EN)

Machine Translation on WMT2016 English-German

BLEU scoreBLEUSacreBLEU

Machine Translation on IWSLT2015 English-Vietnamese

BLEU

Machine Translation on IWSLT2015 English-German

BLEU score

Machine Translation on WMT2014 French-English

BLEUBLEU score

Machine Translation on WMT2016 German-English

BLEU scoreBLEUSacreBLEU

Machine Translation on IWSLT2014 English-German

BLEU score

Machine Translation on WMT2015 English-German

BLEU score

Machine Translation on FLoRes-200

BLEU

Machine Translation on WMT2016 English-Russian

BLEU score

Machine Translation on FRMT (Chinese - Mainland)

BLEURT

Machine Translation on FRMT (Chinese - Taiwan)

BLEURT

Machine Translation on FRMT (Portuguese - Brazil)

BLEURT

Machine Translation on FRMT (Portuguese - Portugal)

BLEURT

Machine Translation on WMT 2017 English-Chinese

BLEU score

Machine Translation on WMT 2017 Latvian-English

BLEU

Machine Translation on WMT2017 Chinese-English

BLEU

Machine Translation on flores95-devtest X-eng

ChrF++

Machine Translation on flores95-devtest eng-X

ChrF++

Machine Translation on IWSLT2015 Vietnamese-English

BLEU

Machine Translation on IWSLT2017 German-English

BLEU score

Machine Translation on Itihasa

SacreBLEU

Machine Translation on WMT 2018 Finnish-English

BLEU

Machine Translation on WMT2014 English-Czech

BLEU score

Machine Translation on WMT2016 English--Romanian

BLEU

Machine Translation on WMT2017 Turkish-English

BLEU score

Machine Translation on WMT2019 English-German

SacreBLEUBLEU score

Machine Translation on ACCURAT balanced test corpus for under resourced languages Russian-Estonian

BLEU

Machine Translation on 20NEWS

1-of-100 AccuracyAccuracy

Machine Translation on ACCURAT balanced test corpus for under resourced languages Estonian-Russian

BLEU

Machine Translation on Alexa Point of View

BLEU

Machine Translation on Arba Sicula

BLEU (En-Scn)BLEU (It-Scn)BLEU (Scn-En)BLEU (Scn-It)

Machine Translation on Business Scene Dialogue EN-JA

BLEU

Machine Translation on Business Scene Dialogue JA-EN

BLEU

Machine Translation on Hindi Visual Genome (Challenge Set)

BLEU (EN-HI)

Machine Translation on Hindi Visual Genome (Test Set)

BLEU (EN-HI)

Machine Translation on IWSLT 2017

BLEU score

Machine Translation on IWSLT2015 Chinese-English

BLEU

Machine Translation on IWSLT2015 Thai-English

BLEU score

Machine Translation on IWSLT2017 Arabic-English

Cased sacreBLEUSacreBLEU

Machine Translation on IWSLT2017 English-Arabic

Cased sacreBLEUSacreBLEU

Machine Translation on IWSLT2017 English-French

Cased sacreBLEUSacreBLEU

Machine Translation on IWSLT2017 French-English

Cased sacreBLEUSacreBLEU

Machine Translation on Multi Lingual Bug Reports

BERTScore

Machine Translation on MultiSubs English-French

ALI

Machine Translation on MultiSubs English-German

ALI

Machine Translation on MultiSubs English-Portuguese

ALI

Machine Translation on MultiSubs English-Spanish

ALI

Machine Translation on OpenSubtitles

BLEU scoreMETEOR

Machine Translation on Tatoeba (EL-to-EN)

BLEU

Machine Translation on Tatoeba (EN-to-EL)

BLEU

Machine Translation on Umsuka

BLEU

Machine Translation on V_A (trained on T_H)

Median Relative Edit Distance

Machine Translation on V_B (trained on T_H)

Median Relative Edit Distance

Machine Translation on V_C (trained on T_H)

Median Relative Edit Distance

Machine Translation on WMT 2017 English-Latvian

BLEU

Machine Translation on WMT 2018 English-Estonian

BLEU

Machine Translation on WMT 2018 English-Finnish

BLEU

Machine Translation on WMT 2018 Estonian-English

BLEU

Machine Translation on WMT 2022 Chinese-English

SacreBLEU

Machine Translation on WMT 2022 Czech-English

SacreBLEU

Machine Translation on WMT 2022 English-Chinese

SacreBLEU

Machine Translation on WMT 2022 English-Czech

SacreBLEU

Machine Translation on WMT 2022 English-German

SacreBLEU

Machine Translation on WMT 2022 English-Japanese

SacreBLEU

Machine Translation on WMT 2022 English-Russian

SacreBLEU

Machine Translation on WMT 2022 German-English

SacreBLEU

Machine Translation on WMT 2022 Japanese-English

SacreBLEU

Machine Translation on WMT 2022 Russian-English

SacreBLEU

Machine Translation on WMT2015 English-Russian

BLEU score

Machine Translation on WMT2016 Czech-English

BLEU score

Machine Translation on WMT2016 English-Czech

BLEU score

Machine Translation on WMT2016 English-French

BLEU score

Machine Translation on WMT2016 Finnish-English

BLEU

Machine Translation on WMT2016 Russian-English

BLEU score

Machine Translation on WMT2017 English-Finnish

BLEU

Machine Translation on WMT2017 English-French

BLEU

Machine Translation on WMT2017 English-German

BLEU

Machine Translation on WMT2017 Finnish-English

BLEU

Machine Translation on WMT2017 Russian-English

BLEU

Machine Translation on WMT2019 English-Japanese

BLEU

Machine Translation on WMT2019 Finnish-English

BLEU

Machine Translation on WMT2019 German-English

SacreBLEU

Machine Translation on slone/myv_ru_2022 myv-ru

ChrF++

Machine Translation on slone/myv_ru_2022 ru-myv

ChrF++