TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/USR - DR (x = f)

USR - DR (x = f)

Reported on 8 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing8 results

  • Open-Domain DialogonUSR-TopicalChat
    Pearson Correlation· 2020-05-01
    0.3221
    best: 0.4974 (Lin-Reg (all))
    USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationarXiv:2005.00456
  • Open-Domain DialogonUSR-TopicalChat
    Spearman Correlation· 2020-05-01
    0.1419
    best: 0.5109 (MDD-Eval)
    USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationarXiv:2005.00456
  • Open-Domain DialogonUSR-PersonaChat
    Pearson Correlation· 2020-05-01
    -0.0454
    best: 0.6087 (USR - DR (x = c))
    USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationarXiv:2005.00456
  • Open-Domain DialogonUSR-PersonaChat
    Spearman Correlation· 2020-05-01
    -0.0495
    best: 0.5382 (Lin-Reg (all))
    USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationarXiv:2005.00456
  • Dialogue EvaluationonUSR-TopicalChat
    Pearson Correlation· 2020-05-01
    0.3221
    best: 0.4974 (Lin-Reg (all))
    USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationarXiv:2005.00456
  • Dialogue EvaluationonUSR-TopicalChat
    Spearman Correlation· 2020-05-01
    0.1419
    best: 0.5109 (MDD-Eval)
    USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationarXiv:2005.00456
  • Dialogue EvaluationonUSR-PersonaChat
    Pearson Correlation· 2020-05-01
    -0.0454
    best: 0.6087 (USR - DR (x = c))
    USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationarXiv:2005.00456
  • Dialogue EvaluationonUSR-PersonaChat
    Spearman Correlation· 2020-05-01
    -0.0495
    best: 0.5382 (Lin-Reg (all))
    USR: An Unsupervised and Reference Free Evaluation Metric for Dialog GenerationarXiv:2005.00456