TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/single-model

single-model

Reported on 12 benchmarks across 2 tasks

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Speech12 results

  • DialogueonVisual Dialog v1.0 test-std
    MRR (x 100)
    64.95
    best: 71.24 (MRR ensemble (Naive))
  • DialogueonVisual Dialog v1.0 test-std
    Mean
    3.44
    best: 49.61 (qqhe)
  • DialogueonVisual Dialog v1.0 test-std
    NDCG (x 100)
    60.31
    best: 78.7 (Single)
  • DialogueonVisual Dialog v1.0 test-std
    R@1
    50.48
    best: 58.3 (2 Step: Factor Graph Attention + VD-Bert)
  • DialogueonVisual Dialog v1.0 test-std
    R@10
    93.15
    best: 95.08 (Ensemble FGA + BERT)
  • DialogueonVisual Dialog v1.0 test-std
    R@5
    83.15
    best: 88.42 (Ensemble FGA + BERT)
  • DialogueonVisual Dialog v1.0 test-std
    MRR (x 100)
    62.56
    best: 71.24 (MRR ensemble (Naive))
  • DialogueonVisual Dialog v1.0 test-std
    Mean
    3.82
    best: 49.61 (qqhe)
  • DialogueonVisual Dialog v1.0 test-std
    NDCG (x 100)
    55.21
    best: 78.7 (Single)
  • DialogueonVisual Dialog v1.0 test-std
    R@1
    47.45
    best: 58.3 (2 Step: Factor Graph Attention + VD-Bert)
  • DialogueonVisual Dialog v1.0 test-std
    R@10
    92
    best: 95.08 (Ensemble FGA + BERT)
  • DialogueonVisual Dialog v1.0 test-std
    R@5
    81.55
    best: 88.42 (Ensemble FGA + BERT)

Computer Vision12 results

  • Visual DialogonVisual Dialog v1.0 test-std
    MRR (x 100)
    64.95
    best: 71.24 (MRR ensemble (Naive))
  • Visual DialogonVisual Dialog v1.0 test-std
    Mean
    3.44
    best: 49.61 (qqhe)
  • Visual DialogonVisual Dialog v1.0 test-std
    NDCG (x 100)
    60.31
    best: 78.7 (Single)
  • Visual DialogonVisual Dialog v1.0 test-std
    R@1
    50.48
    best: 58.3 (2 Step: Factor Graph Attention + VD-Bert)
  • Visual DialogonVisual Dialog v1.0 test-std
    R@10
    93.15
    best: 95.08 (Ensemble FGA + BERT)
  • Visual DialogonVisual Dialog v1.0 test-std
    R@5
    83.15
    best: 88.42 (Ensemble FGA + BERT)
  • Visual DialogonVisual Dialog v1.0 test-std
    MRR (x 100)
    62.56
    best: 71.24 (MRR ensemble (Naive))
  • Visual DialogonVisual Dialog v1.0 test-std
    Mean
    3.82
    best: 49.61 (qqhe)
  • Visual DialogonVisual Dialog v1.0 test-std
    NDCG (x 100)
    55.21
    best: 78.7 (Single)
  • Visual DialogonVisual Dialog v1.0 test-std
    R@1
    47.45
    best: 58.3 (2 Step: Factor Graph Attention + VD-Bert)
  • Visual DialogonVisual Dialog v1.0 test-std
    R@10
    92
    best: 95.08 (Ensemble FGA + BERT)
  • Visual DialogonVisual Dialog v1.0 test-std
    R@5
    81.55
    best: 88.42 (Ensemble FGA + BERT)