Vision and Language Navigation on VLN Challenge

Metric: spl (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	spl▼	Extra Data	Paper	Date↕	Code
1	human	0.76	No	-	-	-
2	Gloabl Normalization pre-explore	0.69	No	-	-	-
3	Active Exploration (Pre-explore)	0.68	No	-	-	-
4	sponge	0.67	No	-	-	-
5	Single-run	0.65	No	-	-	-
6	Self-Supervised Auxiliary Reasoning Tasks (Pre-explore)	0.65	No	Vision-Language Navigation with Self-Supervised ...	2019-11-18	-
7	EnvEdit+PT	0.64	No	-	-	-
8	ESceme Single-run	0.63	No	-	-	-
9	BEVBert	0.62	No	-	-	-
10	GMap	0.62	No	-	-	-
11	CMC-AAL2	0.62	No	-	-	-
12	Greedy, No Pre-explore	0.62	No	-	-	-
13	ReadNet	0.61	No	-	-	-
14	metaexplore	0.61	No	-	-	-
15	DDL	0.61	No	-	-	-
16	coefficient	0.61	No	-	-	-
17	Back Translation with Environmental Dropout (exploring unseen environments before testing)	0.61	No	-	-	-
18	Lily	0.6	No	-	-	-
19	DUET+PASTS	0.6	No	-	-	-
20	CMG-AAL	0.6	No	-	-	-
21	Single-Run, No Pre-Explore	0.6	No	-	-	-
22	TD-STP	0.6	No	-	-	-
23	VLN-BERT-Aug	0.6	No	-	-	-
24	Fortest	0.6	No	-	-	-
25	Single-Run	0.6	No	-	-	-
26	HAMT	0.6	No	-	-	-
27	bin	0.6	No	-	-	-
28	HOC	0.59	No	-	-	-
29	lxyict	0.59	No	-	-	-
30	CVPR22	0.59	No	-	-	-
31	sliu_team	0.59	No	-	-	-
32	WIN	0.59	No	-	-	-
33	WIN + RecVLN BERT	0.59	No	-	-	-
34	single-run	0.59	No	Vision-Language Navigation with Random Environme...	2021-06-15	Code
35	single-run	0.59	No	Vision-Language Navigation with Random Environme...	2021-06-15	Code
36	PANDA-TingLiu	0.59	No	-	-	-
37	single-run	0.59	No	Vision-Language Navigation with Random Environme...	2021-06-15	Code
38	SIL-R2	0.59	No	-	-	-
39	DDL	0.58	No	-	-	-
40	clin	0.58	No	-	-	-
41	Hikari	0.58	No	-	-	-
42	Colab_buaa	0.58	No	-	-	-
43	Geo	0.58	No	-	-	-
44	hellohellohello	0.58	No	-	-	-
45	ed	0.58	No	-	-	-
46	binbin	0.58	No	-	-	-
47	MARVAL	0.58	No	-	-	-
48	SEvol_lzy	0.57	No	-	-	-
49	YBYB	0.57	No	-	-	-
50	Single-Run, No Pre-Explore	0.57	No	-	-	-
51	reg	0.57	No	-	-	-
52	ART	0.57	No	-	-	-
53	GBSE	0.56	No	-	-	-
54	homebody	0.56	No	-	-	-
55	PREVALENT	0.56	No	-	-	-
56	VLN-TreeTrans	0.55	No	-	-	-
57	single-run	0.55	No	-	-	-
58	zq	0.55	No	-	-	-
59	hellohello	0.55	No	-	-	-
60	GraphBert	0.55	No	-	-	-
61	Envdrop+SEVol+BT	0.55	No	-	-	-
62	SEA features + AuxRN (single-run)	0.55	No	-	-	-
63	without pre-explore, beam-search	0.55	No	-	-	-
64	trysth	0.54	No	-	-	-
65	MM2021	0.54	No	Neighbor-view Enhanced Model for Vision and Lang...	2021-07-15	Code
66	a new baseline	0.53	No	-	-	-
67	SQANv1, No Pre-explore	0.53	No	-	-	-
68	Single-Run, No Pre-Explore	0.53	No	-	-	-
69	Greedy	0.53	No	-	-	-
70	OAG(without pre-explore, beam-search)	0.53	No	-	-	-
71	SEA features + Env-Dropout (single-run)	0.53	No	-	-	-
72	reward-vln	0.52	No	-	-	-
73	jmebs	0.52	No	-	-	-
74	Lang-Vis-Entity VLN (Single-Run)	0.52	No	-	-	-
75	27k	0.52	No	-	-	-
76	WQ_Pretrain	0.51	No	-	-	-
77	PREVALENT	0.51	No	-	-	-
78	CMG-AAL-TCSVT	0.5	No	-	-	-
79	test-sf	0.5	No	-	-	-
80	Single-Run	0.5	No	-	-	-
81	map1	0.5	No	-	-	-
82	2m-path	0.5	No	-	-	-
83	single-run	0.5	No	-	-	-
84	CCC(ssm)	0.49	No	-	-	-
85	SERL	0.49	No	-	-	-
86	liuer	0.48	No	-	-	-
87	DCMT	0.48	No	-	-	-
88	SYSU-ISE	0.48	No	-	-	-
89	Back Translation with Environmental Dropout (no beam search)	0.47	No	Learning to Navigate Unseen Environments: Back T...	2019-04-08	Code
90	SERL (no_augmented)	0.47	No	-	-	-
91	Single-Run, No Pre-Explore	0.47	No	-	-	-
92	SSM	0.46	No	-	-	-
93	single run	0.46	No	-	-	-
94	licr19	0.45	No	-	-	-
95	ALTR	0.45	No	Transferable Representation Learning in Vision-a...	2019-08-09	-
96	Single Run	0.43	No	-	-	-
97	naive	0.43	No	-	-	-
98	GVLN	0.42	No	-	-	-
99	Tactical Rewind - short	0.41	No	Tactical Rewind: Self-Correction via Backtrackin...	2019-03-06	Code
100	testliu	0.41	No	-	-	-
101	The Regretful Agent (no beam search; greedy action selection)	0.4	No	The Regretful Agent: Heuristic-Aided Navigation ...	2019-03-05	Code
102	SEA features + Speaker-Follower (single-run)	0.4	No	-	-	-
103	Environment-Agnostic Multitask Learning	0.4	No	Environment-agnostic Multitask Learning for Natu...	2020-03-01	Code
104	speaker_follower_tesk2	0.4	No	-	-	-
105	Reinforced Cross-Modal Matching (single trajectory; NO beam search)	0.38	No	-	-	-
106	selfmoni0	0.36	No	-	-	-
107	PTA	0.36	No	-	-	-
108	Self-Monitoring Navigation Agent (no beam search; Progress Inference)	0.35	No	Self-Monitoring Navigation Agent via Auxiliary P...	2019-01-10	Code
109	DoubleAttn	0.35	No	-	-	-
110	rcm_test	0.33	No	-	-	-
111	AnonymousTeam	0.32	No	-	-	-
112	ai like samurai with PNasNet5Large	0.31	No	-	-	-
113	Dynamic Convolutional Filters	0.31	No	-	-	-
114	Khanh Nguyen	0.3	No	-	-	-
115	HAIL	0.3	No	-	-	-
116	base_1	0.25	No	-	-	-
117	fuse_1	0.25	No	-	-	-
118	base_0	0.23	No	-	-	-
119	Look Before You Leap	0.23	No	-	-	-
120	X-Modal	0.22	No	-	-	-
121	Self-Supervised Auxiliary Reasoning Tasks (Beam Search)	0.21	No	Vision-Language Navigation with Self-Supervised ...	2019-11-18	-
122	test_an	0.21	No	-	-	-
123	no	0.2	No	-	-	-
124	zhangyong	0.18	No	-	-	-
125	Seq2Seq Baseline	0.18	No	-	-	-
126	zy123	0.16	No	-	-	-
127	zzzzzzzz55768	0.12	No	-	-	-
128	Random Agent	0.12	No	-	-	-
129	Active Exploration (Beam Search)	0.05	No	-	-	-
130	Tactical Rewind - long	0.03	No	Tactical Rewind: Self-Correction via Backtrackin...	2019-03-06	Code
131	Reinforced Cross-Modal Matching (optimized for SR; with beam search)	0.02	No	-	-	-
132	Self-Aware Co-Grounded Model	0.02	No	-	-	-
133	1111	0.02	No	-	-	-
134	Lily	0.01	No	-	-	-
135	Airbert	0.01	No	Airbert: In-domain Pretraining for Vision-and-La...	2021-08-20	Code
136	Global Normalization	0.01	No	-	-	-
137	explore@40 beam-search	0.01	No	-	-	-
138	VLN-Bert	0.01	No	Improving Vision-and-Language Navigation with Im...	2020-04-30	Code
139	FOAM-Beam Search	0.01	No	-	-	-
140	SERL (Beam_Search)	0.01	No	-	-	-
141	ADad	0.01	No	-	-	-
142	null	0.01	No	Learning to Navigate Unseen Environments: Back T...	2019-04-08	Code
143	null	0.01	No	Learning to Navigate Unseen Environments: Back T...	2019-04-08	Code
144	Speaker-Follower	0.01	No	-	-	-
145	15458	0	No	-	-	-

#1human
0.76
spl
No paper
#2Gloabl Normalization pre-explore
0.69
spl
No paper
#3Active Exploration (Pre-explore)
0.68
spl
No paper
#4sponge
0.67
spl
No paper
#5Single-run
0.65
spl
No paper
#6Self-Supervised Auxiliary Reasoning Tasks (Pre-explore)SOTA
0.65
spl· 2019-11-18
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks
#7EnvEdit+PT
0.64
spl
No paper
#8ESceme Single-run
0.63
spl
No paper
#9BEVBert
0.62
spl
No paper
#10GMap
0.62
spl
No paper
#11CMC-AAL2
0.62
spl
No paper
#12Greedy, No Pre-explore
0.62
spl
No paper
#13ReadNet
0.61
spl
No paper
#14metaexplore
0.61
spl
No paper
#15DDL
0.61
spl
No paper
#16coefficient
0.61
spl
No paper
#17Back Translation with Environmental Dropout (exploring unseen environments before testing)
0.61
spl
No paper
#18Lily
0.6
spl
No paper
#19DUET+PASTS
0.6
spl
No paper
#20CMG-AAL
0.6
spl
No paper
#21Single-Run, No Pre-Explore
0.6
spl
No paper
#22TD-STP
0.6
spl
No paper
#23VLN-BERT-Aug
0.6
spl
No paper
#24Fortest
0.6
spl
No paper
#25Single-Run
0.6
spl
No paper
#26HAMT
0.6
spl
No paper
#27bin
0.6
spl
No paper
#28HOC
0.59
spl
No paper
#29lxyict
0.59
spl
No paper
#30CVPR22
0.59
spl
No paper
#31sliu_team
0.59
spl
No paper
#32WIN
0.59
spl
No paper
#33WIN + RecVLN BERT
0.59
spl
No paper
#34single-run
0.59
spl· 2021-06-15
Vision-Language Navigation with Random Environmental Mixup Code
#35single-run
0.59
spl· 2021-06-15
Vision-Language Navigation with Random Environmental Mixup Code
#36PANDA-TingLiu
0.59
spl
No paper
#37single-run
0.59
spl· 2021-06-15
Vision-Language Navigation with Random Environmental Mixup Code
#38SIL-R2
0.59
spl
No paper
#39DDL
0.58
spl
No paper
#40clin
0.58
spl
No paper
#41Hikari
0.58
spl
No paper
#42Colab_buaa
0.58
spl
No paper
#43Geo
0.58
spl
No paper
#44hellohellohello
0.58
spl
No paper
#45ed
0.58
spl
No paper
#46binbin
0.58
spl
No paper
#47MARVAL
0.58
spl
No paper
#48SEvol_lzy
0.57
spl
No paper
#49YBYB
0.57
spl
No paper
#50Single-Run, No Pre-Explore
0.57
spl
No paper
#51reg
0.57
spl
No paper
#52ART
0.57
spl
No paper
#53GBSE
0.56
spl
No paper
#54homebody
0.56
spl
No paper
#55PREVALENT
0.56
spl
No paper
#56VLN-TreeTrans
0.55
spl
No paper
#57single-run
0.55
spl
No paper
#58zq
0.55
spl
No paper
#59hellohello
0.55
spl
No paper
#60GraphBert
0.55
spl
No paper
#61Envdrop+SEVol+BT
0.55
spl
No paper
#62SEA features + AuxRN (single-run)
0.55
spl
No paper
#63without pre-explore, beam-search
0.55
spl
No paper
#64trysth
0.54
spl
No paper
#65MM2021
0.54
spl· 2021-07-15
Neighbor-view Enhanced Model for Vision and Language Navigation Code
#66a new baseline
0.53
spl
No paper
#67SQANv1, No Pre-explore
0.53
spl
No paper
#68Single-Run, No Pre-Explore
0.53
spl
No paper
#69Greedy
0.53
spl
No paper
#70OAG(without pre-explore, beam-search)
0.53
spl
No paper
#71SEA features + Env-Dropout (single-run)
0.53
spl
No paper
#72reward-vln
0.52
spl
No paper
#73jmebs
0.52
spl
No paper
#74Lang-Vis-Entity VLN (Single-Run)
0.52
spl
No paper
#7527k
0.52
spl
No paper
#76WQ_Pretrain
0.51
spl
No paper
#77PREVALENT
0.51
spl
No paper
#78CMG-AAL-TCSVT
0.5
spl
No paper
#79test-sf
0.5
spl
No paper
#80Single-Run
0.5
spl
No paper
#81map1
0.5
spl
No paper
#822m-path
0.5
spl
No paper
#83single-run
0.5
spl
No paper
#84CCC(ssm)
0.49
spl
No paper
#85SERL
0.49
spl
No paper
#86liuer
0.48
spl
No paper
#87DCMT
0.48
spl
No paper
#88SYSU-ISE
0.48
spl
No paper
#89Back Translation with Environmental Dropout (no beam search)SOTA
0.47
spl· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout Code
#90SERL (no_augmented)
0.47
spl
No paper
#91Single-Run, No Pre-Explore
0.47
spl
No paper
#92SSM
0.46
spl
No paper
#93single run
0.46
spl
No paper
#94licr19
0.45
spl
No paper
#95ALTR
0.45
spl· 2019-08-09
Transferable Representation Learning in Vision-and-Language Navigation
#96Single Run
0.43
spl
No paper
#97naive
0.43
spl
No paper
#98GVLN
0.42
spl
No paper
#99Tactical Rewind - shortSOTA
0.41
spl· 2019-03-06
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation Code
#100testliu
0.41
spl
No paper
#101The Regretful Agent (no beam search; greedy action selection)SOTA
0.4
spl· 2019-03-05
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation Code
#102SEA features + Speaker-Follower (single-run)
0.4
spl
No paper
#103Environment-Agnostic Multitask Learning
0.4
spl· 2020-03-01
Environment-agnostic Multitask Learning for Natural Language Grounded Navigation Code
#104speaker_follower_tesk2
0.4
spl
No paper
#105Reinforced Cross-Modal Matching (single trajectory; NO beam search)
0.38
spl
No paper
#106selfmoni0
0.36
spl
No paper
#107PTA
0.36
spl
No paper
#108Self-Monitoring Navigation Agent (no beam search; Progress Inference)SOTA
0.35
spl· 2019-01-10
Self-Monitoring Navigation Agent via Auxiliary Progress Estimation Code
#109DoubleAttn
0.35
spl
No paper
#110rcm_test
0.33
spl
No paper
#111AnonymousTeam
0.32
spl
No paper
#112ai like samurai with PNasNet5Large
0.31
spl
No paper
#113Dynamic Convolutional Filters
0.31
spl
No paper
#114Khanh Nguyen
0.3
spl
No paper
#115HAIL
0.3
spl
No paper
#116base_1
0.25
spl
No paper
#117fuse_1
0.25
spl
No paper
#118base_0
0.23
spl
No paper
#119Look Before You Leap
0.23
spl
No paper
#120X-Modal
0.22
spl
No paper
#121Self-Supervised Auxiliary Reasoning Tasks (Beam Search)
0.21
spl· 2019-11-18
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks
#122test_an
0.21
spl
No paper
#123no
0.2
spl
No paper
#124zhangyong
0.18
spl
No paper
#125Seq2Seq Baseline
0.18
spl
No paper
#126zy123
0.16
spl
No paper
#127zzzzzzzz55768
0.12
spl
No paper
#128Random Agent
0.12
spl
No paper
#129Active Exploration (Beam Search)
0.05
spl
No paper
#130Tactical Rewind - long
0.03
spl· 2019-03-06
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation Code
#131Reinforced Cross-Modal Matching (optimized for SR; with beam search)
0.02
spl
No paper
#132Self-Aware Co-Grounded Model
0.02
spl
No paper
#1331111
0.02
spl
No paper
#134Lily
0.01
spl
No paper
#135Airbert
0.01
spl· 2021-08-20
Airbert: In-domain Pretraining for Vision-and-Language Navigation Code
#136Global Normalization
0.01
spl
No paper
#137explore@40 beam-search
0.01
spl
No paper
#138VLN-Bert
0.01
spl· 2020-04-30
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web Code
#139FOAM-Beam Search
0.01
spl
No paper
#140SERL (Beam_Search)
0.01
spl
No paper
#141ADad
0.01
spl
No paper
#142null
0.01
spl· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout Code
#143null
0.01
spl· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout Code
#144Speaker-Follower
0.01
spl
No paper
#14515458
0
spl
No paper