Tasks
SotA
Datasets
Papers
Methods
Submit
About
SotA
/
Robots
/
Vision and Language Navigation
/
VLN Challenge
Vision and Language Navigation on VLN Challenge
Metric: spl (higher is better)
Leaderboard
Dataset
Loading chart...
Results
Submit a result
Export CSV
Sort:
spl (best first)
spl (worst first)
Date (newest first)
Date (oldest first)
Model name (A→Z)
#
Model
↕
spl
▼
Extra Data
Paper
Date
↕
Code
1
human
0.76
No
-
-
-
2
Gloabl Normalization pre-explore
0.69
No
-
-
-
3
Active Exploration (Pre-explore)
0.68
No
-
-
-
4
sponge
0.67
No
-
-
-
5
Single-run
0.65
No
-
-
-
6
Self-Supervised Auxiliary Reasoning Tasks (Pre-explore)
0.65
No
Vision-Language Navigation with Self-Supervised ...
2019-11-18
-
7
EnvEdit+PT
0.64
No
-
-
-
8
ESceme Single-run
0.63
No
-
-
-
9
BEVBert
0.62
No
-
-
-
10
GMap
0.62
No
-
-
-
11
CMC-AAL2
0.62
No
-
-
-
12
Greedy, No Pre-explore
0.62
No
-
-
-
13
ReadNet
0.61
No
-
-
-
14
metaexplore
0.61
No
-
-
-
15
DDL
0.61
No
-
-
-
16
coefficient
0.61
No
-
-
-
17
Back Translation with Environmental Dropout (exploring unseen environments before testing)
0.61
No
-
-
-
18
Lily
0.6
No
-
-
-
19
DUET+PASTS
0.6
No
-
-
-
20
CMG-AAL
0.6
No
-
-
-
21
Single-Run, No Pre-Explore
0.6
No
-
-
-
22
TD-STP
0.6
No
-
-
-
23
VLN-BERT-Aug
0.6
No
-
-
-
24
Fortest
0.6
No
-
-
-
25
Single-Run
0.6
No
-
-
-
26
HAMT
0.6
No
-
-
-
27
bin
0.6
No
-
-
-
28
HOC
0.59
No
-
-
-
29
lxyict
0.59
No
-
-
-
30
CVPR22
0.59
No
-
-
-
31
sliu_team
0.59
No
-
-
-
32
WIN
0.59
No
-
-
-
33
WIN + RecVLN BERT
0.59
No
-
-
-
34
single-run
0.59
No
Vision-Language Navigation with Random Environme...
2021-06-15
Code
35
single-run
0.59
No
Vision-Language Navigation with Random Environme...
2021-06-15
Code
36
PANDA-TingLiu
0.59
No
-
-
-
37
single-run
0.59
No
Vision-Language Navigation with Random Environme...
2021-06-15
Code
38
SIL-R2
0.59
No
-
-
-
39
DDL
0.58
No
-
-
-
40
clin
0.58
No
-
-
-
41
Hikari
0.58
No
-
-
-
42
Colab_buaa
0.58
No
-
-
-
43
Geo
0.58
No
-
-
-
44
hellohellohello
0.58
No
-
-
-
45
ed
0.58
No
-
-
-
46
binbin
0.58
No
-
-
-
47
MARVAL
0.58
No
-
-
-
48
SEvol_lzy
0.57
No
-
-
-
49
YBYB
0.57
No
-
-
-
50
Single-Run, No Pre-Explore
0.57
No
-
-
-
51
reg
0.57
No
-
-
-
52
ART
0.57
No
-
-
-
53
GBSE
0.56
No
-
-
-
54
homebody
0.56
No
-
-
-
55
PREVALENT
0.56
No
-
-
-
56
VLN-TreeTrans
0.55
No
-
-
-
57
single-run
0.55
No
-
-
-
58
zq
0.55
No
-
-
-
59
hellohello
0.55
No
-
-
-
60
GraphBert
0.55
No
-
-
-
61
Envdrop+SEVol+BT
0.55
No
-
-
-
62
SEA features + AuxRN (single-run)
0.55
No
-
-
-
63
without pre-explore, beam-search
0.55
No
-
-
-
64
trysth
0.54
No
-
-
-
65
MM2021
0.54
No
Neighbor-view Enhanced Model for Vision and Lang...
2021-07-15
Code
66
a new baseline
0.53
No
-
-
-
67
SQANv1, No Pre-explore
0.53
No
-
-
-
68
Single-Run, No Pre-Explore
0.53
No
-
-
-
69
Greedy
0.53
No
-
-
-
70
OAG(without pre-explore, beam-search)
0.53
No
-
-
-
71
SEA features + Env-Dropout (single-run)
0.53
No
-
-
-
72
reward-vln
0.52
No
-
-
-
73
jmebs
0.52
No
-
-
-
74
Lang-Vis-Entity VLN (Single-Run)
0.52
No
-
-
-
75
27k
0.52
No
-
-
-
76
WQ_Pretrain
0.51
No
-
-
-
77
PREVALENT
0.51
No
-
-
-
78
CMG-AAL-TCSVT
0.5
No
-
-
-
79
test-sf
0.5
No
-
-
-
80
Single-Run
0.5
No
-
-
-
81
map1
0.5
No
-
-
-
82
2m-path
0.5
No
-
-
-
83
single-run
0.5
No
-
-
-
84
CCC(ssm)
0.49
No
-
-
-
85
SERL
0.49
No
-
-
-
86
liuer
0.48
No
-
-
-
87
DCMT
0.48
No
-
-
-
88
SYSU-ISE
0.48
No
-
-
-
89
Back Translation with Environmental Dropout (no beam search)
0.47
No
Learning to Navigate Unseen Environments: Back T...
2019-04-08
Code
90
SERL (no_augmented)
0.47
No
-
-
-
91
Single-Run, No Pre-Explore
0.47
No
-
-
-
92
SSM
0.46
No
-
-
-
93
single run
0.46
No
-
-
-
94
licr19
0.45
No
-
-
-
95
ALTR
0.45
No
Transferable Representation Learning in Vision-a...
2019-08-09
-
96
Single Run
0.43
No
-
-
-
97
naive
0.43
No
-
-
-
98
GVLN
0.42
No
-
-
-
99
Tactical Rewind - short
0.41
No
Tactical Rewind: Self-Correction via Backtrackin...
2019-03-06
Code
100
testliu
0.41
No
-
-
-
101
The Regretful Agent (no beam search; greedy action selection)
0.4
No
The Regretful Agent: Heuristic-Aided Navigation ...
2019-03-05
Code
102
SEA features + Speaker-Follower (single-run)
0.4
No
-
-
-
103
Environment-Agnostic Multitask Learning
0.4
No
Environment-agnostic Multitask Learning for Natu...
2020-03-01
Code
104
speaker_follower_tesk2
0.4
No
-
-
-
105
Reinforced Cross-Modal Matching (single trajectory; NO beam search)
0.38
No
-
-
-
106
selfmoni0
0.36
No
-
-
-
107
PTA
0.36
No
-
-
-
108
Self-Monitoring Navigation Agent (no beam search; Progress Inference)
0.35
No
Self-Monitoring Navigation Agent via Auxiliary P...
2019-01-10
Code
109
DoubleAttn
0.35
No
-
-
-
110
rcm_test
0.33
No
-
-
-
111
AnonymousTeam
0.32
No
-
-
-
112
ai like samurai with PNasNet5Large
0.31
No
-
-
-
113
Dynamic Convolutional Filters
0.31
No
-
-
-
114
Khanh Nguyen
0.3
No
-
-
-
115
HAIL
0.3
No
-
-
-
116
base_1
0.25
No
-
-
-
117
fuse_1
0.25
No
-
-
-
118
base_0
0.23
No
-
-
-
119
Look Before You Leap
0.23
No
-
-
-
120
X-Modal
0.22
No
-
-
-
121
Self-Supervised Auxiliary Reasoning Tasks (Beam Search)
0.21
No
Vision-Language Navigation with Self-Supervised ...
2019-11-18
-
122
test_an
0.21
No
-
-
-
123
no
0.2
No
-
-
-
124
zhangyong
0.18
No
-
-
-
125
Seq2Seq Baseline
0.18
No
-
-
-
126
zy123
0.16
No
-
-
-
127
zzzzzzzz55768
0.12
No
-
-
-
128
Random Agent
0.12
No
-
-
-
129
Active Exploration (Beam Search)
0.05
No
-
-
-
130
Tactical Rewind - long
0.03
No
Tactical Rewind: Self-Correction via Backtrackin...
2019-03-06
Code
131
Reinforced Cross-Modal Matching (optimized for SR; with beam search)
0.02
No
-
-
-
132
Self-Aware Co-Grounded Model
0.02
No
-
-
-
133
1111
0.02
No
-
-
-
134
Lily
0.01
No
-
-
-
135
Airbert
0.01
No
Airbert: In-domain Pretraining for Vision-and-La...
2021-08-20
Code
136
Global Normalization
0.01
No
-
-
-
137
explore@40 beam-search
0.01
No
-
-
-
138
VLN-Bert
0.01
No
Improving Vision-and-Language Navigation with Im...
2020-04-30
Code
139
FOAM-Beam Search
0.01
No
-
-
-
140
SERL (Beam_Search)
0.01
No
-
-
-
141
ADad
0.01
No
-
-
-
142
null
0.01
No
Learning to Navigate Unseen Environments: Back T...
2019-04-08
Code
143
null
0.01
No
Learning to Navigate Unseen Environments: Back T...
2019-04-08
Code
144
Speaker-Follower
0.01
No
-
-
-
145
15458
0
No
-
-
-
#1
human
0.76
spl
No paper
#2
Gloabl Normalization pre-explore
0.69
spl
No paper
#3
Active Exploration (Pre-explore)
0.68
spl
No paper
#4
sponge
0.67
spl
No paper
#5
Single-run
0.65
spl
No paper
#6
Self-Supervised Auxiliary Reasoning Tasks (Pre-explore)
SOTA
0.65
spl
· 2019-11-18
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks
#7
EnvEdit+PT
0.64
spl
No paper
#8
ESceme Single-run
0.63
spl
No paper
#9
BEVBert
0.62
spl
No paper
#10
GMap
0.62
spl
No paper
#11
CMC-AAL2
0.62
spl
No paper
#12
Greedy, No Pre-explore
0.62
spl
No paper
#13
ReadNet
0.61
spl
No paper
#14
metaexplore
0.61
spl
No paper
#15
DDL
0.61
spl
No paper
#16
coefficient
0.61
spl
No paper
#17
Back Translation with Environmental Dropout (exploring unseen environments before testing)
0.61
spl
No paper
#18
Lily
0.6
spl
No paper
#19
DUET+PASTS
0.6
spl
No paper
#20
CMG-AAL
0.6
spl
No paper
#21
Single-Run, No Pre-Explore
0.6
spl
No paper
#22
TD-STP
0.6
spl
No paper
#23
VLN-BERT-Aug
0.6
spl
No paper
#24
Fortest
0.6
spl
No paper
#25
Single-Run
0.6
spl
No paper
#26
HAMT
0.6
spl
No paper
#27
bin
0.6
spl
No paper
#28
HOC
0.59
spl
No paper
#29
lxyict
0.59
spl
No paper
#30
CVPR22
0.59
spl
No paper
#31
sliu_team
0.59
spl
No paper
#32
WIN
0.59
spl
No paper
#33
WIN + RecVLN BERT
0.59
spl
No paper
#34
single-run
0.59
spl
· 2021-06-15
Vision-Language Navigation with Random Environmental Mixup
Code
#35
single-run
0.59
spl
· 2021-06-15
Vision-Language Navigation with Random Environmental Mixup
Code
#36
PANDA-TingLiu
0.59
spl
No paper
#37
single-run
0.59
spl
· 2021-06-15
Vision-Language Navigation with Random Environmental Mixup
Code
#38
SIL-R2
0.59
spl
No paper
#39
DDL
0.58
spl
No paper
#40
clin
0.58
spl
No paper
#41
Hikari
0.58
spl
No paper
#42
Colab_buaa
0.58
spl
No paper
#43
Geo
0.58
spl
No paper
#44
hellohellohello
0.58
spl
No paper
#45
ed
0.58
spl
No paper
#46
binbin
0.58
spl
No paper
#47
MARVAL
0.58
spl
No paper
#48
SEvol_lzy
0.57
spl
No paper
#49
YBYB
0.57
spl
No paper
#50
Single-Run, No Pre-Explore
0.57
spl
No paper
#51
reg
0.57
spl
No paper
#52
ART
0.57
spl
No paper
#53
GBSE
0.56
spl
No paper
#54
homebody
0.56
spl
No paper
#55
PREVALENT
0.56
spl
No paper
#56
VLN-TreeTrans
0.55
spl
No paper
#57
single-run
0.55
spl
No paper
#58
zq
0.55
spl
No paper
#59
hellohello
0.55
spl
No paper
#60
GraphBert
0.55
spl
No paper
#61
Envdrop+SEVol+BT
0.55
spl
No paper
#62
SEA features + AuxRN (single-run)
0.55
spl
No paper
#63
without pre-explore, beam-search
0.55
spl
No paper
#64
trysth
0.54
spl
No paper
#65
MM2021
0.54
spl
· 2021-07-15
Neighbor-view Enhanced Model for Vision and Language Navigation
Code
#66
a new baseline
0.53
spl
No paper
#67
SQANv1, No Pre-explore
0.53
spl
No paper
#68
Single-Run, No Pre-Explore
0.53
spl
No paper
#69
Greedy
0.53
spl
No paper
#70
OAG(without pre-explore, beam-search)
0.53
spl
No paper
#71
SEA features + Env-Dropout (single-run)
0.53
spl
No paper
#72
reward-vln
0.52
spl
No paper
#73
jmebs
0.52
spl
No paper
#74
Lang-Vis-Entity VLN (Single-Run)
0.52
spl
No paper
#75
27k
0.52
spl
No paper
#76
WQ_Pretrain
0.51
spl
No paper
#77
PREVALENT
0.51
spl
No paper
#78
CMG-AAL-TCSVT
0.5
spl
No paper
#79
test-sf
0.5
spl
No paper
#80
Single-Run
0.5
spl
No paper
#81
map1
0.5
spl
No paper
#82
2m-path
0.5
spl
No paper
#83
single-run
0.5
spl
No paper
#84
CCC(ssm)
0.49
spl
No paper
#85
SERL
0.49
spl
No paper
#86
liuer
0.48
spl
No paper
#87
DCMT
0.48
spl
No paper
#88
SYSU-ISE
0.48
spl
No paper
#89
Back Translation with Environmental Dropout (no beam search)
SOTA
0.47
spl
· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout
Code
#90
SERL (no_augmented)
0.47
spl
No paper
#91
Single-Run, No Pre-Explore
0.47
spl
No paper
#92
SSM
0.46
spl
No paper
#93
single run
0.46
spl
No paper
#94
licr19
0.45
spl
No paper
#95
ALTR
0.45
spl
· 2019-08-09
Transferable Representation Learning in Vision-and-Language Navigation
#96
Single Run
0.43
spl
No paper
#97
naive
0.43
spl
No paper
#98
GVLN
0.42
spl
No paper
#99
Tactical Rewind - short
SOTA
0.41
spl
· 2019-03-06
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Code
#100
testliu
0.41
spl
No paper
#101
The Regretful Agent (no beam search; greedy action selection)
SOTA
0.4
spl
· 2019-03-05
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation
Code
#102
SEA features + Speaker-Follower (single-run)
0.4
spl
No paper
#103
Environment-Agnostic Multitask Learning
0.4
spl
· 2020-03-01
Environment-agnostic Multitask Learning for Natural Language Grounded Navigation
Code
#104
speaker_follower_tesk2
0.4
spl
No paper
#105
Reinforced Cross-Modal Matching (single trajectory; NO beam search)
0.38
spl
No paper
#106
selfmoni0
0.36
spl
No paper
#107
PTA
0.36
spl
No paper
#108
Self-Monitoring Navigation Agent (no beam search; Progress Inference)
SOTA
0.35
spl
· 2019-01-10
Self-Monitoring Navigation Agent via Auxiliary Progress Estimation
Code
#109
DoubleAttn
0.35
spl
No paper
#110
rcm_test
0.33
spl
No paper
#111
AnonymousTeam
0.32
spl
No paper
#112
ai like samurai with PNasNet5Large
0.31
spl
No paper
#113
Dynamic Convolutional Filters
0.31
spl
No paper
#114
Khanh Nguyen
0.3
spl
No paper
#115
HAIL
0.3
spl
No paper
#116
base_1
0.25
spl
No paper
#117
fuse_1
0.25
spl
No paper
#118
base_0
0.23
spl
No paper
#119
Look Before You Leap
0.23
spl
No paper
#120
X-Modal
0.22
spl
No paper
#121
Self-Supervised Auxiliary Reasoning Tasks (Beam Search)
0.21
spl
· 2019-11-18
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks
#122
test_an
0.21
spl
No paper
#123
no
0.2
spl
No paper
#124
zhangyong
0.18
spl
No paper
#125
Seq2Seq Baseline
0.18
spl
No paper
#126
zy123
0.16
spl
No paper
#127
zzzzzzzz55768
0.12
spl
No paper
#128
Random Agent
0.12
spl
No paper
#129
Active Exploration (Beam Search)
0.05
spl
No paper
#130
Tactical Rewind - long
0.03
spl
· 2019-03-06
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation
Code
#131
Reinforced Cross-Modal Matching (optimized for SR; with beam search)
0.02
spl
No paper
#132
Self-Aware Co-Grounded Model
0.02
spl
No paper
#133
1111
0.02
spl
No paper
#134
Lily
0.01
spl
No paper
#135
Airbert
0.01
spl
· 2021-08-20
Airbert: In-domain Pretraining for Vision-and-Language Navigation
Code
#136
Global Normalization
0.01
spl
No paper
#137
explore@40 beam-search
0.01
spl
No paper
#138
VLN-Bert
0.01
spl
· 2020-04-30
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web
Code
#139
FOAM-Beam Search
0.01
spl
No paper
#140
SERL (Beam_Search)
0.01
spl
No paper
#141
ADad
0.01
spl
No paper
#142
null
0.01
spl
· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout
Code
#143
null
0.01
spl
· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout
Code
#144
Speaker-Follower
0.01
spl
No paper
#145
15458
0
spl
No paper