Vision and Language Navigation on VLN Challenge

Metric: success (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	success▼	Extra Data	Paper	Date↕	Code
1	human	0.86	No	-	-	-
2	Lily	0.79	No	-	-	-
3	Airbert	0.78	No	Airbert: In-domain Pretraining for Vision-and-La...	2021-08-20	Code
4	Global Normalization	0.74	No	-	-	-
5	explore@40 beam-search	0.74	No	-	-	-
6	VLN-Bert	0.73	No	Improving Vision-and-Language Navigation with Im...	2020-04-30	Code
7	BEVBert	0.73	No	-	-	-
8	GMap	0.73	No	-	-	-
9	Gloabl Normalization pre-explore	0.73	No	-	-	-
10	FOAM-Beam Search	0.72	No	-	-	-
11	Lily	0.72	No	-	-	-
12	ReadNet	0.72	No	-	-	-
13	Active Exploration (Beam Search)	0.71	No	-	-	-
14	Self-Supervised Auxiliary Reasoning Tasks (Beam Search)	0.71	No	Vision-Language Navigation with Self-Supervised ...	2019-11-18	-
15	HOC	0.71	No	-	-	-
16	metaexplore	0.71	No	-	-	-
17	sponge	0.71	No	-	-	-
18	SERL (Beam_Search)	0.7	No	-	-	-
19	lxyict	0.7	No	-	-	-
20	DUET+PASTS	0.7	No	-	-	-
21	Single-run	0.7	No	-	-	-
22	Active Exploration (Pre-explore)	0.7	No	-	-	-
23	ADad	0.69	No	-	-	-
24	null	0.69	No	Learning to Navigate Unseen Environments: Back T...	2019-04-08	Code
25	CVPR22	0.69	No	-	-	-
26	CMC-AAL2	0.69	No	-	-	-
27	EnvEdit+PT	0.68	No	-	-	-
28	Self-Supervised Auxiliary Reasoning Tasks (Pre-explore)	0.68	No	Vision-Language Navigation with Self-Supervised ...	2019-11-18	-
29	DDL	0.67	No	-	-	-
30	CMG-AAL	0.67	No	-	-	-
31	VLN-TreeTrans	0.66	No	-	-	-
32	sliu_team	0.66	No	-	-	-
33	Single-Run, No Pre-Explore	0.66	No	-	-	-
34	TD-STP	0.66	No	-	-	-
35	VLN-BERT-Aug	0.66	No	-	-	-
36	Fortest	0.66	No	-	-	-
37	ESceme Single-run	0.66	No	-	-	-
38	WIN	0.65	No	-	-	-
39	WIN + RecVLN BERT	0.65	No	-	-	-
40	single-run	0.65	No	Vision-Language Navigation with Random Environme...	2021-06-15	Code
41	Single-Run	0.65	No	-	-	-
42	HAMT	0.65	No	-	-	-
43	coefficient	0.65	No	-	-	-
44	bin	0.65	No	-	-	-
45	Greedy, No Pre-explore	0.65	No	-	-	-
46	DDL	0.64	No	-	-	-
47	clin	0.64	No	-	-	-
48	single-run	0.64	No	-	-	-
49	PANDA-TingLiu	0.64	No	-	-	-
50	single-run	0.64	No	-	-	-
51	Back Translation with Environmental Dropout (exploring unseen environments before testing)	0.64	No	-	-	-
52	Reinforced Cross-Modal Matching (optimized for SR; with beam search)	0.63	No	-	-	-
53	Hikari	0.63	No	-	-	-
54	SEvol_lzy	0.63	No	-	-	-
55	Colab_buaa	0.63	No	-	-	-
56	Geo	0.63	No	-	-	-
57	YBYB	0.63	No	-	-	-
58	hellohellohello	0.63	No	-	-	-
59	ed	0.63	No	-	-	-
60	Single-Run, No Pre-Explore	0.63	No	-	-	-
61	reg	0.63	No	-	-	-
62	ART	0.63	No	-	-	-
63	binbin	0.63	No	-	-	-
64	CCC(ssm)	0.62	No	-	-	-
65	MARVAL	0.62	No	-	-	-
66	Self-Aware Co-Grounded Model	0.61	No	-	-	-
67	Tactical Rewind - long	0.61	No	Tactical Rewind: Self-Correction via Backtrackin...	2019-03-06	Code
68	SSM	0.61	No	-	-	-
69	single-run	0.61	No	-	-	-
70	zq	0.61	No	-	-	-
71	GBSE	0.61	No	-	-	-
72	hellohello	0.61	No	-	-	-
73	homebody	0.61	No	-	-	-
74	GraphBert	0.61	No	-	-	-
75	Single Run	0.6	No	-	-	-
76	SIL-R2	0.6	No	-	-	-
77	Envdrop+SEVol+BT	0.59	No	-	-	-
78	a new baseline	0.59	No	-	-	-
79	trysth	0.59	No	-	-	-
80	SEA features + AuxRN (single-run)	0.59	No	-	-	-
81	PREVALENT	0.59	No	-	-	-
82	SQANv1, No Pre-explore	0.58	No	-	-	-
83	MM2021	0.58	No	Neighbor-view Enhanced Model for Vision and Lang...	2021-07-15	Code
84	without pre-explore, beam-search	0.58	No	-	-	-
85	CMG-AAL-TCSVT	0.57	No	-	-	-
86	Single-Run, No Pre-Explore	0.57	No	-	-	-
87	test-sf	0.57	No	-	-	-
88	Greedy	0.57	No	-	-	-
89	null	0.56	No	-	-	-
90	liuer	0.56	No	-	-	-
91	reward-vln	0.56	No	-	-	-
92	OAG(without pre-explore, beam-search)	0.56	No	-	-	-
93	jmebs	0.56	No	-	-	-
94	SEA features + Env-Dropout (single-run)	0.56	No	-	-	-
95	Single-Run	0.55	No	-	-	-
96	WQ_Pretrain	0.55	No	-	-	-
97	Lang-Vis-Entity VLN (Single-Run)	0.55	No	-	-	-
98	Tactical Rewind - short	0.54	No	Tactical Rewind: Self-Correction via Backtrackin...	2019-03-06	Code
99	single run	0.54	No	-	-	-
100	DCMT	0.54	No	-	-	-
101	map1	0.54	No	-	-	-
102	PREVALENT	0.54	No	-	-	-
103	27k	0.54	No	-	-	-
104	Speaker-Follower	0.53	No	-	-	-
105	GVLN	0.53	No	-	-	-
106	SERL	0.53	No	-	-	-
107	2m-path	0.53	No	-	-	-
108	single-run	0.53	No	-	-	-
109	SYSU-ISE	0.52	No	-	-	-
110	licr19	0.51	No	-	-	-
111	Back Translation with Environmental Dropout (no beam search)	0.51	No	Learning to Navigate Unseen Environments: Back T...	2019-04-08	Code
112	SERL (no_augmented)	0.51	No	-	-	-
113	Single-Run, No Pre-Explore	0.51	No	-	-	-
114	testliu	0.49	No	-	-	-
115	Self-Monitoring Navigation Agent (no beam search; Progress Inference)	0.48	No	Self-Monitoring Navigation Agent via Auxiliary P...	2019-01-10	Code
116	The Regretful Agent (no beam search; greedy action selection)	0.48	No	The Regretful Agent: Heuristic-Aided Navigation ...	2019-03-05	Code
117	ALTR	0.48	No	Transferable Representation Learning in Vision-a...	2019-08-09	-
118	selfmoni0	0.47	No	-	-	-
119	DoubleAttn	0.47	No	-	-	-
120	SEA features + Speaker-Follower (single-run)	0.47	No	-	-	-
121	naive	0.47	No	-	-	-
122	Environment-Agnostic Multitask Learning	0.45	No	Environment-agnostic Multitask Learning for Natu...	2020-03-01	Code
123	speaker_follower_tesk2	0.45	No	-	-	-
124	Reinforced Cross-Modal Matching (single trajectory; NO beam search)	0.43	No	-	-	-
125	PTA	0.4	No	-	-	-
126	Khanh Nguyen	0.37	No	-	-	-
127	HAIL	0.36	No	-	-	-
128	rcm_test	0.36	No	-	-	-
129	ai like samurai with PNasNet5Large	0.36	No	-	-	-
130	Dynamic Convolutional Filters	0.35	No	-	-	-
131	AnonymousTeam	0.34	No	-	-	-
132	base_1	0.33	No	-	-	-
133	fuse_1	0.31	No	-	-	-
134	no	0.3	No	-	-	-
135	base_0	0.29	No	-	-	-
136	test_an	0.26	No	-	-	-
137	Look Before You Leap	0.25	No	-	-	-
138	X-Modal	0.24	No	-	-	-
139	zhangyong	0.2	No	-	-	-
140	Seq2Seq Baseline	0.2	No	-	-	-
141	zy123	0.18	No	-	-	-
142	zzzzzzzz55768	0.14	No	-	-	-
143	Random Agent	0.13	No	-	-	-
144	1111	0.07	No	-	-	-
145	15458	0	No	-	-	-

#1human
0.86
success
No paper
#2Lily
0.79
success
No paper
#3AirbertSOTA
0.78
success· 2021-08-20
Airbert: In-domain Pretraining for Vision-and-Language Navigation Code
#4Global Normalization
0.74
success
No paper
#5explore@40 beam-search
0.74
success
No paper
#6VLN-BertSOTA
0.73
success· 2020-04-30
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web Code
#7BEVBert
0.73
success
No paper
#8GMap
0.73
success
No paper
#9Gloabl Normalization pre-explore
0.73
success
No paper
#10FOAM-Beam Search
0.72
success
No paper
#11Lily
0.72
success
No paper
#12ReadNet
0.72
success
No paper
#13Active Exploration (Beam Search)
0.71
success
No paper
#14Self-Supervised Auxiliary Reasoning Tasks (Beam Search)SOTA
0.71
success· 2019-11-18
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks
#15HOC
0.71
success
No paper
#16metaexplore
0.71
success
No paper
#17sponge
0.71
success
No paper
#18SERL (Beam_Search)
0.7
success
No paper
#19lxyict
0.7
success
No paper
#20DUET+PASTS
0.7
success
No paper
#21Single-run
0.7
success
No paper
#22Active Exploration (Pre-explore)
0.7
success
No paper
#23ADad
0.69
success
No paper
#24nullSOTA
0.69
success· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout Code
#25CVPR22
0.69
success
No paper
#26CMC-AAL2
0.69
success
No paper
#27EnvEdit+PT
0.68
success
No paper
#28Self-Supervised Auxiliary Reasoning Tasks (Pre-explore)
0.68
success· 2019-11-18
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks
#29DDL
0.67
success
No paper
#30CMG-AAL
0.67
success
No paper
#31VLN-TreeTrans
0.66
success
No paper
#32sliu_team
0.66
success
No paper
#33Single-Run, No Pre-Explore
0.66
success
No paper
#34TD-STP
0.66
success
No paper
#35VLN-BERT-Aug
0.66
success
No paper
#36Fortest
0.66
success
No paper
#37ESceme Single-run
0.66
success
No paper
#38WIN
0.65
success
No paper
#39WIN + RecVLN BERT
0.65
success
No paper
#40single-run
0.65
success· 2021-06-15
Vision-Language Navigation with Random Environmental Mixup Code
#41Single-Run
0.65
success
No paper
#42HAMT
0.65
success
No paper
#43coefficient
0.65
success
No paper
#44bin
0.65
success
No paper
#45Greedy, No Pre-explore
0.65
success
No paper
#46DDL
0.64
success
No paper
#47clin
0.64
success
No paper
#48single-run
0.64
success
No paper
#49PANDA-TingLiu
0.64
success
No paper
#50single-run
0.64
success
No paper
#51Back Translation with Environmental Dropout (exploring unseen environments before testing)
0.64
success
No paper
#52Reinforced Cross-Modal Matching (optimized for SR; with beam search)
0.63
success
No paper
#53Hikari
0.63
success
No paper
#54SEvol_lzy
0.63
success
No paper
#55Colab_buaa
0.63
success
No paper
#56Geo
0.63
success
No paper
#57YBYB
0.63
success
No paper
#58hellohellohello
0.63
success
No paper
#59ed
0.63
success
No paper
#60Single-Run, No Pre-Explore
0.63
success
No paper
#61reg
0.63
success
No paper
#62ART
0.63
success
No paper
#63binbin
0.63
success
No paper
#64CCC(ssm)
0.62
success
No paper
#65MARVAL
0.62
success
No paper
#66Self-Aware Co-Grounded Model
0.61
success
No paper
#67Tactical Rewind - longSOTA
0.61
success· 2019-03-06
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation Code
#68SSM
0.61
success
No paper
#69single-run
0.61
success
No paper
#70zq
0.61
success
No paper
#71GBSE
0.61
success
No paper
#72hellohello
0.61
success
No paper
#73homebody
0.61
success
No paper
#74GraphBert
0.61
success
No paper
#75Single Run
0.6
success
No paper
#76SIL-R2
0.6
success
No paper
#77Envdrop+SEVol+BT
0.59
success
No paper
#78a new baseline
0.59
success
No paper
#79trysth
0.59
success
No paper
#80SEA features + AuxRN (single-run)
0.59
success
No paper
#81PREVALENT
0.59
success
No paper
#82SQANv1, No Pre-explore
0.58
success
No paper
#83MM2021
0.58
success· 2021-07-15
Neighbor-view Enhanced Model for Vision and Language Navigation Code
#84without pre-explore, beam-search
0.58
success
No paper
#85CMG-AAL-TCSVT
0.57
success
No paper
#86Single-Run, No Pre-Explore
0.57
success
No paper
#87test-sf
0.57
success
No paper
#88Greedy
0.57
success
No paper
#89null
0.56
success
No paper
#90liuer
0.56
success
No paper
#91reward-vln
0.56
success
No paper
#92OAG(without pre-explore, beam-search)
0.56
success
No paper
#93jmebs
0.56
success
No paper
#94SEA features + Env-Dropout (single-run)
0.56
success
No paper
#95Single-Run
0.55
success
No paper
#96WQ_Pretrain
0.55
success
No paper
#97Lang-Vis-Entity VLN (Single-Run)
0.55
success
No paper
#98Tactical Rewind - short
0.54
success· 2019-03-06
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation Code
#99single run
0.54
success
No paper
#100DCMT
0.54
success
No paper
#101map1
0.54
success
No paper
#102PREVALENT
0.54
success
No paper
#10327k
0.54
success
No paper
#104Speaker-Follower
0.53
success
No paper
#105GVLN
0.53
success
No paper
#106SERL
0.53
success
No paper
#1072m-path
0.53
success
No paper
#108single-run
0.53
success
No paper
#109SYSU-ISE
0.52
success
No paper
#110licr19
0.51
success
No paper
#111Back Translation with Environmental Dropout (no beam search)
0.51
success· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout Code
#112SERL (no_augmented)
0.51
success
No paper
#113Single-Run, No Pre-Explore
0.51
success
No paper
#114testliu
0.49
success
No paper
#115Self-Monitoring Navigation Agent (no beam search; Progress Inference)SOTA
0.48
success· 2019-01-10
Self-Monitoring Navigation Agent via Auxiliary Progress Estimation Code
#116The Regretful Agent (no beam search; greedy action selection)
0.48
success· 2019-03-05
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation Code
#117ALTR
0.48
success· 2019-08-09
Transferable Representation Learning in Vision-and-Language Navigation
#118selfmoni0
0.47
success
No paper
#119DoubleAttn
0.47
success
No paper
#120SEA features + Speaker-Follower (single-run)
0.47
success
No paper
#121naive
0.47
success
No paper
#122Environment-Agnostic Multitask Learning
0.45
success· 2020-03-01
Environment-agnostic Multitask Learning for Natural Language Grounded Navigation Code
#123speaker_follower_tesk2
0.45
success
No paper
#124Reinforced Cross-Modal Matching (single trajectory; NO beam search)
0.43
success
No paper
#125PTA
0.4
success
No paper
#126Khanh Nguyen
0.37
success
No paper
#127HAIL
0.36
success
No paper
#128rcm_test
0.36
success
No paper
#129ai like samurai with PNasNet5Large
0.36
success
No paper
#130Dynamic Convolutional Filters
0.35
success
No paper
#131AnonymousTeam
0.34
success
No paper
#132base_1
0.33
success
No paper
#133fuse_1
0.31
success
No paper
#134no
0.3
success
No paper
#135base_0
0.29
success
No paper
#136test_an
0.26
success
No paper
#137Look Before You Leap
0.25
success
No paper
#138X-Modal
0.24
success
No paper
#139zhangyong
0.2
success
No paper
#140Seq2Seq Baseline
0.2
success
No paper
#141zy123
0.18
success
No paper
#142zzzzzzzz55768
0.14
success
No paper
#143Random Agent
0.13
success
No paper
#1441111
0.07
success
No paper
#14515458
0
success
No paper