AM2iCo

AM2iCo is a wide-coverage and carefully designed cross-lingual and multilingual evaluation set. It aims to assess the ability of state-of-the-art representation models to reason over cross-lingual lexical-level concept alignment in context for 14 language pairs.

English (EN), German (DE), Russian (RU), Japanese (JA), Korean (KO), Mandarin Chinese(ZH), Arabic(AR), Indonesian(IN), Finnish(FI), Turkish(TR), Basque(EU), Georgian(KA), Urdu(UR), Bengali(BN), Kazakh(KK).