CommonMT

Introduced 2020-11-01

The CommonMT is a dataset used for evaluating commonsense reasoning in neural machine translation. This dataset contains three types of test suites:

  • Lexical ambiguity
  • Contextless syntactic ambiguity
  • Contextual syntactic ambiguity