HRE-QIH-D

Reported on 22 benchmarks across 2 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Speech16 results

DialogueonVisual Dialog v1.0 test-std
Mean· 2016-11-26
6.41
best: 49.61 (qqhe)
SOTA
Visual Dialog arXiv:1611.08669
DialogueonVisDial v0.9 val
MRR· 2016-11-26
0.5846
best: 68.92 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
DialogueonVisDial v0.9 val
Mean Rank· 2016-11-26
5.72
best: 5.84 (HieCoAtt-QI)
Visual Dialog arXiv:1611.08669
DialogueonVisDial v0.9 val
R@1· 2016-11-26
44.67
best: 55.16 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
DialogueonVisDial v0.9 val
R@10· 2016-11-26
84.22
best: 92.95 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
DialogueonVisDial v0.9 val
R@5· 2016-11-26
74.5
best: 86.26 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
DialogueonVisDial v0.9 val
MRR· 2016-11-26
0.5807
best: 68.92 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
DialogueonVisDial v0.9 val
Mean Rank· 2016-11-26
5.78
best: 5.84 (HieCoAtt-QI)
Visual Dialog arXiv:1611.08669
DialogueonVisDial v0.9 val
R@1· 2016-11-26
43.82
best: 55.16 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
DialogueonVisDial v0.9 val
R@10· 2016-11-26
84.07
best: 92.95 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
DialogueonVisDial v0.9 val
R@5· 2016-11-26
74.68
best: 86.26 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
DialogueonVisual Dialog v1.0 test-std
MRR (x 100)· 2016-11-26
54.2
best: 71.24 (MRR ensemble (Naive))
Visual Dialog arXiv:1611.08669
DialogueonVisual Dialog v1.0 test-std
NDCG (x 100)· 2016-11-26
45.5
best: 78.7 (Single)
Visual Dialog arXiv:1611.08669
DialogueonVisual Dialog v1.0 test-std
R@1· 2016-11-26
39.93
best: 58.3 (2 Step: Factor Graph Attention + VD-Bert)
Visual Dialog arXiv:1611.08669
DialogueonVisual Dialog v1.0 test-std
R@10· 2016-11-26
81.5
best: 95.08 (Ensemble FGA + BERT)
Visual Dialog arXiv:1611.08669
DialogueonVisual Dialog v1.0 test-std
R@5· 2016-11-26
70.45
best: 88.42 (Ensemble FGA + BERT)
Visual Dialog arXiv:1611.08669

Computer Vision16 results

Visual DialogonVisual Dialog v1.0 test-std
Mean· 2016-11-26
6.41
best: 49.61 (qqhe)
SOTA
Visual Dialog arXiv:1611.08669
Visual DialogonVisDial v0.9 val
MRR· 2016-11-26
0.5846
best: 68.92 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
Visual DialogonVisDial v0.9 val
Mean Rank· 2016-11-26
5.72
best: 5.84 (HieCoAtt-QI)
Visual Dialog arXiv:1611.08669
Visual DialogonVisDial v0.9 val
R@1· 2016-11-26
44.67
best: 55.16 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
Visual DialogonVisDial v0.9 val
R@10· 2016-11-26
84.22
best: 92.95 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
Visual DialogonVisDial v0.9 val
R@5· 2016-11-26
74.5
best: 86.26 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
Visual DialogonVisDial v0.9 val
MRR· 2016-11-26
0.5807
best: 68.92 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
Visual DialogonVisDial v0.9 val
Mean Rank· 2016-11-26
5.78
best: 5.84 (HieCoAtt-QI)
Visual Dialog arXiv:1611.08669
Visual DialogonVisDial v0.9 val
R@1· 2016-11-26
43.82
best: 55.16 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
Visual DialogonVisDial v0.9 val
R@10· 2016-11-26
84.07
best: 92.95 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
Visual DialogonVisDial v0.9 val
R@5· 2016-11-26
74.68
best: 86.26 (9xFGA (VGG))
Visual Dialog arXiv:1611.08669
Visual DialogonVisual Dialog v1.0 test-std
MRR (x 100)· 2016-11-26
54.2
best: 71.24 (MRR ensemble (Naive))
Visual Dialog arXiv:1611.08669
Visual DialogonVisual Dialog v1.0 test-std
NDCG (x 100)· 2016-11-26
45.5
best: 78.7 (Single)
Visual Dialog arXiv:1611.08669
Visual DialogonVisual Dialog v1.0 test-std
R@1· 2016-11-26
39.93
best: 58.3 (2 Step: Factor Graph Attention + VD-Bert)
Visual Dialog arXiv:1611.08669
Visual DialogonVisual Dialog v1.0 test-std
R@10· 2016-11-26
81.5
best: 95.08 (Ensemble FGA + BERT)
Visual Dialog arXiv:1611.08669
Visual DialogonVisual Dialog v1.0 test-std
R@5· 2016-11-26
70.45
best: 88.42 (Ensemble FGA + BERT)
Visual Dialog arXiv:1611.08669