The Regretful Agent (no beam search; greedy action selection)

Reported on 5 benchmarks across 1 task · 1 paper · 1 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Robots5 results

Vision and Language NavigationonVLN Challenge
spl· 2019-03-05
0.4
best: 0.76 (human)
SOTA
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation arXiv:1903.01602
Vision and Language NavigationonVLN Challenge
error· 2019-03-05
5.69
best: 1.61 (human)
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation arXiv:1903.01602
Vision and Language NavigationonVLN Challenge
length· 2019-03-05
13.69
best: 1257.38 (Speaker-Follower)
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation arXiv:1903.01602
Vision and Language NavigationonVLN Challenge
oracle success· 2019-03-05
0.56
best: 1 (FOAM-Beam Search)
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation arXiv:1903.01602
Vision and Language NavigationonVLN Challenge
success· 2019-03-05
0.48
best: 0.86 (human)
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation arXiv:1903.01602