TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/UniLM

UniLM

Reported on 14 benchmarks across 5 tasks · 2 papers · 13 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing7 results

  • Question AnsweringonCoQA
    F1-Score· uses extra data· 2019-05-08
    82.5
    best: 84.5 (ERNIE-GEN)
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Abstractive Text SummarizationonCNN / Daily Mail
    ROUGE-1· uses extra data· 2019-05-08
    43.08
    best: 48.18 (Scrambled code + broken (alter))
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Abstractive Text SummarizationonCNN / Daily Mail
    ROUGE-2· uses extra data· 2019-05-08
    20.43
    best: 24.02 (Pegasus)
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Abstractive Text SummarizationonCNN / Daily Mail
    ROUGE-L· uses extra data· 2019-05-08
    40.34
    best: 45.35 (Scrambled code + broken (alter))
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Question GenerationonSQuAD1.1
    BLEU-4· uses extra data· 2019-05-08
    22.78
    best: 25.41 (ERNIE-GENLARGE (beam size=5))
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Question GenerationonSQuAD1.1
    METEOR· uses extra data· 2019-05-08
    25.1
    best: 26.73 (BART (TextBox 2.0))
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Question GenerationonSQuAD1.1
    ROUGE-L· uses extra data· 2019-05-08
    51.1
    best: 52.8 (ProphetNet + ASGen)
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197

Knowledge Base6 results

  • Text SummarizationonGigaWord
    ROUGE-1· uses extra data· 2019-05-08
    38.9
    best: 60.12 (OpenAI/o3-mini)
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Text SummarizationonGigaWord
    ROUGE-2· uses extra data· 2019-05-08
    20.05
    best: 54.22 (OpenAI/o3-mini)
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Text SummarizationonGigaWord
    ROUGE-L· uses extra data· 2019-05-08
    36
    best: 60.29 (Riple/Saanvi-v0.1)
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Text SummarizationonCNN / Daily Mail
    ROUGE-2· uses extra data· 2019-05-08
    20.43
    best: 24.02 (Pegasus)
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Text SummarizationonCNN / Daily Mail
    ROUGE-L· uses extra data· 2019-05-08
    40.34
    best: 45.35 (Scrambled code + broken (alter))
    SOTA
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197
  • Text SummarizationonCNN / Daily Mail
    ROUGE-1· uses extra data· 2019-05-08
    43.08
    best: 48.18 (Scrambled code + broken (alter))
    Unified Language Model Pre-training for Natural Language Understanding and GenerationarXiv:1905.03197

Adversarial1 result

  • Text GenerationonCommonGen
    CIDEr· 2019-11-09
    14.92
    SOTA
    CommonGen: A Constrained Text Generation Challenge for Generative Commonsense ReasoningarXiv:1911.03705