Tasks
SotA
Datasets
Papers
Methods
Submit
About
SotA
/
Robots
/
Vision and Language Navigation
/
VLN Challenge
Vision and Language Navigation on VLN Challenge
Metric: success (higher is better)
Leaderboard
Dataset
Loading chart...
Results
Submit a result
Export CSV
Sort:
success (best first)
success (worst first)
Date (newest first)
Date (oldest first)
Model name (A→Z)
#
Model
↕
success
▼
Extra Data
Paper
Date
↕
Code
1
human
0.86
No
-
-
-
2
Lily
0.79
No
-
-
-
3
Airbert
0.78
No
Airbert: In-domain Pretraining for Vision-and-La...
2021-08-20
Code
4
Global Normalization
0.74
No
-
-
-
5
explore@40 beam-search
0.74
No
-
-
-
6
VLN-Bert
0.73
No
Improving Vision-and-Language Navigation with Im...
2020-04-30
Code
7
BEVBert
0.73
No
-
-
-
8
GMap
0.73
No
-
-
-
9
Gloabl Normalization pre-explore
0.73
No
-
-
-
10
FOAM-Beam Search
0.72
No
-
-
-
11
Lily
0.72
No
-
-
-
12
ReadNet
0.72
No
-
-
-
13
Active Exploration (Beam Search)
0.71
No
-
-
-
14
Self-Supervised Auxiliary Reasoning Tasks (Beam Search)
0.71
No
Vision-Language Navigation with Self-Supervised ...
2019-11-18
-
15
HOC
0.71
No
-
-
-
16
metaexplore
0.71
No
-
-
-
17
sponge
0.71
No
-
-
-
18
SERL (Beam_Search)
0.7
No
-
-
-
19
lxyict
0.7
No
-
-
-
20
DUET+PASTS
0.7
No
-
-
-
21
Single-run
0.7
No
-
-
-
22
Active Exploration (Pre-explore)
0.7
No
-
-
-
23
ADad
0.69
No
-
-
-
24
null
0.69
No
Learning to Navigate Unseen Environments: Back T...
2019-04-08
Code
25
CVPR22
0.69
No
-
-
-
26
CMC-AAL2
0.69
No
-
-
-
27
EnvEdit+PT
0.68
No
-
-
-
28
Self-Supervised Auxiliary Reasoning Tasks (Pre-explore)
0.68
No
Vision-Language Navigation with Self-Supervised ...
2019-11-18
-
29
DDL
0.67
No
-
-
-
30
CMG-AAL
0.67
No
-
-
-
31
VLN-TreeTrans
0.66
No
-
-
-
32
sliu_team
0.66
No
-
-
-
33
Single-Run, No Pre-Explore
0.66
No
-
-
-
34
TD-STP
0.66
No
-
-
-
35
VLN-BERT-Aug
0.66
No
-
-
-
36
Fortest
0.66
No
-
-
-
37
ESceme Single-run
0.66
No
-
-
-
38
WIN
0.65
No
-
-
-
39
WIN + RecVLN BERT
0.65
No
-
-
-
40
single-run
0.65
No
Vision-Language Navigation with Random Environme...
2021-06-15
Code
41
Single-Run
0.65
No
-
-
-
42
HAMT
0.65
No
-
-
-
43
coefficient
0.65
No
-
-
-
44
bin
0.65
No
-
-
-
45
Greedy, No Pre-explore
0.65
No
-
-
-
46
DDL
0.64
No
-
-
-
47
clin
0.64
No
-
-
-
48
single-run
0.64
No
-
-
-
49
PANDA-TingLiu
0.64
No
-
-
-
50
single-run
0.64
No
-
-
-
51
Back Translation with Environmental Dropout (exploring unseen environments before testing)
0.64
No
-
-
-
52
Reinforced Cross-Modal Matching (optimized for SR; with beam search)
0.63
No
-
-
-
53
Hikari
0.63
No
-
-
-
54
SEvol_lzy
0.63
No
-
-
-
55
Colab_buaa
0.63
No
-
-
-
56
Geo
0.63
No
-
-
-
57
YBYB
0.63
No
-
-
-
58
hellohellohello
0.63
No
-
-
-
59
ed
0.63
No
-
-
-
60
Single-Run, No Pre-Explore
0.63
No
-
-
-
61
reg
0.63
No
-
-
-
62
ART
0.63
No
-
-
-
63
binbin
0.63
No
-
-
-
64
CCC(ssm)
0.62
No
-
-
-
65
MARVAL
0.62
No
-
-
-
66
Self-Aware Co-Grounded Model
0.61
No
-
-
-
67
Tactical Rewind - long
0.61
No
Tactical Rewind: Self-Correction via Backtrackin...
2019-03-06
Code
68
SSM
0.61
No
-
-
-
69
single-run
0.61
No
-
-
-
70
zq
0.61
No
-
-
-
71
GBSE
0.61
No
-
-
-
72
hellohello
0.61
No
-
-
-
73
homebody
0.61
No
-
-
-
74
GraphBert
0.61
No
-
-
-
75
Single Run
0.6
No
-
-
-
76
SIL-R2
0.6
No
-
-
-
77
Envdrop+SEVol+BT
0.59
No
-
-
-
78
a new baseline
0.59
No
-
-
-
79
trysth
0.59
No
-
-
-
80
SEA features + AuxRN (single-run)
0.59
No
-
-
-
81
PREVALENT
0.59
No
-
-
-
82
SQANv1, No Pre-explore
0.58
No
-
-
-
83
MM2021
0.58
No
Neighbor-view Enhanced Model for Vision and Lang...
2021-07-15
Code
84
without pre-explore, beam-search
0.58
No
-
-
-
85
CMG-AAL-TCSVT
0.57
No
-
-
-
86
Single-Run, No Pre-Explore
0.57
No
-
-
-
87
test-sf
0.57
No
-
-
-
88
Greedy
0.57
No
-
-
-
89
null
0.56
No
-
-
-
90
liuer
0.56
No
-
-
-
91
reward-vln
0.56
No
-
-
-
92
OAG(without pre-explore, beam-search)
0.56
No
-
-
-
93
jmebs
0.56
No
-
-
-
94
SEA features + Env-Dropout (single-run)
0.56
No
-
-
-
95
Single-Run
0.55
No
-
-
-
96
WQ_Pretrain
0.55
No
-
-
-
97
Lang-Vis-Entity VLN (Single-Run)
0.55
No
-
-
-
98
Tactical Rewind - short
0.54
No
Tactical Rewind: Self-Correction via Backtrackin...
2019-03-06
Code
99
single run
0.54
No
-
-
-
100
DCMT
0.54
No
-
-
-
101
map1
0.54
No
-
-
-
102
PREVALENT
0.54
No
-
-
-
103
27k
0.54
No
-
-
-
104
Speaker-Follower
0.53
No
-
-
-
105
GVLN
0.53
No
-
-
-
106
SERL
0.53
No
-
-
-
107
2m-path
0.53
No
-
-
-
108
single-run
0.53
No
-
-
-
109
SYSU-ISE
0.52
No
-
-
-
110
licr19
0.51
No
-
-
-
111
Back Translation with Environmental Dropout (no beam search)
0.51
No
Learning to Navigate Unseen Environments: Back T...
2019-04-08
Code
112
SERL (no_augmented)
0.51
No
-
-
-
113
Single-Run, No Pre-Explore
0.51
No
-
-
-
114
testliu
0.49
No
-
-
-
115
Self-Monitoring Navigation Agent (no beam search; Progress Inference)
0.48
No
Self-Monitoring Navigation Agent via Auxiliary P...
2019-01-10
Code
116
The Regretful Agent (no beam search; greedy action selection)
0.48
No
The Regretful Agent: Heuristic-Aided Navigation ...
2019-03-05
Code
117
ALTR
0.48
No
Transferable Representation Learning in Vision-a...
2019-08-09
-
118
selfmoni0
0.47
No
-
-
-
119
DoubleAttn
0.47
No
-
-
-
120
SEA features + Speaker-Follower (single-run)
0.47
No
-
-
-
121
naive
0.47
No
-
-
-
122
Environment-Agnostic Multitask Learning
0.45
No
Environment-agnostic Multitask Learning for Natu...
2020-03-01
Code
123
speaker_follower_tesk2
0.45
No
-
-
-
124
Reinforced Cross-Modal Matching (single trajectory; NO beam search)
0.43
No
-
-
-
125
PTA
0.4
No
-
-
-
126
Khanh Nguyen
0.37
No
-
-
-
127
HAIL
0.36
No
-
-
-
128
rcm_test
0.36
No
-
-
-
129
ai like samurai with PNasNet5Large
0.36
No
-
-
-
130
Dynamic Convolutional Filters
0.35
No
-
-
-
131
AnonymousTeam
0.34
No
-
-
-
132
base_1
0.33
No
-
-
-
133
fuse_1
0.31
No
-
-
-
134
no
0.3
No
-
-
-
135
base_0
0.29
No
-
-
-
136
test_an
0.26
No
-
-
-
137
Look Before You Leap
0.25
No
-
-
-
138
X-Modal
0.24
No
-
-
-
139
zhangyong
0.2
No
-
-
-
140
Seq2Seq Baseline
0.2
No
-
-
-
141
zy123
0.18
No
-
-
-
142
zzzzzzzz55768
0.14
No
-
-
-
143
Random Agent
0.13
No
-
-
-
144
1111
0.07
No
-
-
-
145
15458
0
No
-
-
-
#1
human
0.86
success
No paper
#2
Lily
0.79
success
No paper
#3
Airbert
SOTA
0.78
success
· 2021-08-20
Airbert: In-domain Pretraining for Vision-and-Language Navigation
Code
#4
Global Normalization
0.74
success
No paper
#5
explore@40 beam-search
0.74
success
No paper
#6
VLN-Bert
SOTA
0.73
success
· 2020-04-30
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web
Code
#7
BEVBert
0.73
success
No paper
#8
GMap
0.73
success
No paper
#9
Gloabl Normalization pre-explore
0.73
success
No paper
#10
FOAM-Beam Search
0.72
success
No paper
#11
Lily
0.72
success
No paper
#12
ReadNet
0.72
success
No paper
#13
Active Exploration (Beam Search)
0.71
success
No paper
#14
Self-Supervised Auxiliary Reasoning Tasks (Beam Search)
SOTA
0.71
success
· 2019-11-18
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks
#15
HOC
0.71
success
No paper
#16
metaexplore
0.71
success
No paper
#17
sponge
0.71
success
No paper
#18
SERL (Beam_Search)
0.7
success
No paper
#19
lxyict
0.7
success
No paper
#20
DUET+PASTS
0.7
success
No paper
#21
Single-run
0.7
success
No paper
#22
Active Exploration (Pre-explore)
0.7
success
No paper
#23
ADad
0.69
success
No paper
#24
null
SOTA
0.69
success
· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout
Code
#25
CVPR22
0.69
success
No paper
#26
CMC-AAL2
0.69
success
No paper
#27
EnvEdit+PT
0.68
success
No paper
#28
Self-Supervised Auxiliary Reasoning Tasks (Pre-explore)
0.68
success
· 2019-11-18
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks
#29
DDL
0.67
success
No paper
#30
CMG-AAL
0.67
success
No paper
#31
VLN-TreeTrans
0.66
success
No paper
#32
sliu_team
0.66
success
No paper
#33
Single-Run, No Pre-Explore
0.66
success
No paper
#34
TD-STP
0.66
success
No paper
#35
VLN-BERT-Aug
0.66
success
No paper
#36
Fortest
0.66
success
No paper
#37
ESceme Single-run
0.66
success
No paper
#38
WIN
0.65
success
No paper
#39
WIN + RecVLN BERT
0.65
success
No paper
#40
single-run
0.65
success
· 2021-06-15
Vision-Language Navigation with Random Environmental Mixup
Code
#41
Single-Run
0.65
success
No paper
#42
HAMT
0.65
success
No paper
#43
coefficient
0.65
success
No paper
#44
bin
0.65
success
No paper
#45
Greedy, No Pre-explore
0.65
success
No paper
#46
DDL
0.64
success
No paper
#47
clin
0.64
success
No paper
#48
single-run
0.64
success
No paper
#49
PANDA-TingLiu
0.64
success
No paper
#50
single-run
0.64
success
No paper
#51
Back Translation with Environmental Dropout (exploring unseen environments before testing)
0.64
success
No paper
#52
Reinforced Cross-Modal Matching (optimized for SR; with beam search)
0.63
success
No paper
#53
Hikari
0.63
success
No paper
#54
SEvol_lzy
0.63
success
No paper
#55
Colab_buaa
0.63
success
No paper
#56
Geo
0.63
success
No paper
#57
YBYB
0.63
success
No paper
#58
hellohellohello
0.63
success
No paper
#59
ed
0.63
success
No paper
#60
Single-Run, No Pre-Explore
0.63
success
No paper
#61
reg
0.63
success
No paper
#62
ART
0.63
success
No paper
#63
binbin
0.63
success
No paper
#64
CCC(ssm)
0.62
success
No paper
#65
MARVAL
0.62
success
No paper
#66
Self-Aware Co-Grounded Model
0.61
success
No paper
#67
Tactical Rewind - long
SOTA
0.61
success
· 2019-03-06
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Code
#68
SSM
0.61
success
No paper
#69
single-run
0.61
success
No paper
#70
zq
0.61
success
No paper
#71
GBSE
0.61
success
No paper
#72
hellohello
0.61
success
No paper
#73
homebody
0.61
success
No paper
#74
GraphBert
0.61
success
No paper
#75
Single Run
0.6
success
No paper
#76
SIL-R2
0.6
success
No paper
#77
Envdrop+SEVol+BT
0.59
success
No paper
#78
a new baseline
0.59
success
No paper
#79
trysth
0.59
success
No paper
#80
SEA features + AuxRN (single-run)
0.59
success
No paper
#81
PREVALENT
0.59
success
No paper
#82
SQANv1, No Pre-explore
0.58
success
No paper
#83
MM2021
0.58
success
· 2021-07-15
Neighbor-view Enhanced Model for Vision and Language Navigation
Code
#84
without pre-explore, beam-search
0.58
success
No paper
#85
CMG-AAL-TCSVT
0.57
success
No paper
#86
Single-Run, No Pre-Explore
0.57
success
No paper
#87
test-sf
0.57
success
No paper
#88
Greedy
0.57
success
No paper
#89
null
0.56
success
No paper
#90
liuer
0.56
success
No paper
#91
reward-vln
0.56
success
No paper
#92
OAG(without pre-explore, beam-search)
0.56
success
No paper
#93
jmebs
0.56
success
No paper
#94
SEA features + Env-Dropout (single-run)
0.56
success
No paper
#95
Single-Run
0.55
success
No paper
#96
WQ_Pretrain
0.55
success
No paper
#97
Lang-Vis-Entity VLN (Single-Run)
0.55
success
No paper
#98
Tactical Rewind - short
0.54
success
· 2019-03-06
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Code
#99
single run
0.54
success
No paper
#100
DCMT
0.54
success
No paper
#101
map1
0.54
success
No paper
#102
PREVALENT
0.54
success
No paper
#103
27k
0.54
success
No paper
#104
Speaker-Follower
0.53
success
No paper
#105
GVLN
0.53
success
No paper
#106
SERL
0.53
success
No paper
#107
2m-path
0.53
success
No paper
#108
single-run
0.53
success
No paper
#109
SYSU-ISE
0.52
success
No paper
#110
licr19
0.51
success
No paper
#111
Back Translation with Environmental Dropout (no beam search)
0.51
success
· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout
Code
#112
SERL (no_augmented)
0.51
success
No paper
#113
Single-Run, No Pre-Explore
0.51
success
No paper
#114
testliu
0.49
success
No paper
#115
Self-Monitoring Navigation Agent (no beam search; Progress Inference)
SOTA
0.48
success
· 2019-01-10
Self-Monitoring Navigation Agent via Auxiliary Progress Estimation
Code
#116
The Regretful Agent (no beam search; greedy action selection)
0.48
success
· 2019-03-05
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation
Code
#117
ALTR
0.48
success
· 2019-08-09
Transferable Representation Learning in Vision-and-Language Navigation
#118
selfmoni0
0.47
success
No paper
#119
DoubleAttn
0.47
success
No paper
#120
SEA features + Speaker-Follower (single-run)
0.47
success
No paper
#121
naive
0.47
success
No paper
#122
Environment-Agnostic Multitask Learning
0.45
success
· 2020-03-01
Environment-agnostic Multitask Learning for Natural Language Grounded Navigation
Code
#123
speaker_follower_tesk2
0.45
success
No paper
#124
Reinforced Cross-Modal Matching (single trajectory; NO beam search)
0.43
success
No paper
#125
PTA
0.4
success
No paper
#126
Khanh Nguyen
0.37
success
No paper
#127
HAIL
0.36
success
No paper
#128
rcm_test
0.36
success
No paper
#129
ai like samurai with PNasNet5Large
0.36
success
No paper
#130
Dynamic Convolutional Filters
0.35
success
No paper
#131
AnonymousTeam
0.34
success
No paper
#132
base_1
0.33
success
No paper
#133
fuse_1
0.31
success
No paper
#134
no
0.3
success
No paper
#135
base_0
0.29
success
No paper
#136
test_an
0.26
success
No paper
#137
Look Before You Leap
0.25
success
No paper
#138
X-Modal
0.24
success
No paper
#139
zhangyong
0.2
success
No paper
#140
Seq2Seq Baseline
0.2
success
No paper
#141
zy123
0.18
success
No paper
#142
zzzzzzzz55768
0.14
success
No paper
#143
Random Agent
0.13
success
No paper
#144
1111
0.07
success
No paper
#145
15458
0
success
No paper