Vision and Language Navigation on VLN Challenge

Metric: length (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	length▼	Extra Data	Paper	Date↕	Code
1	Speaker-Follower	1257.38	No	-	-	-
2	FOAM-Beam Search	1250.89	No	-	-	-
3	null	1214.94	No	-	-	-
4	ADad	786.35	No	-	-	-
5	SERL (Beam_Search)	690.61	No	-	-	-
6	Global Normalization	686.86	No	-	-	-
7	null	686.82	No	Learning to Navigate Unseen Environments: Back T...	2019-04-08	Code
8	VLN-Bert	686.62	No	Improving Vision-and-Language Navigation with Im...	2020-04-30	Code
9	Airbert	686.54	No	Airbert: In-domain Pretraining for Vision-and-La...	2021-08-20	Code
10	Lily	686.45	No	-	-	-
11	explore@40 beam-search	625.27	No	-	-	-
12	Self-Aware Co-Grounded Model	373.09	No	-	-	-
13	Reinforced Cross-Modal Matching (optimized for SR; with beam search)	357.62	No	-	-	-
14	Tactical Rewind - long	196.53	No	Tactical Rewind: Self-Correction via Backtrackin...	2019-03-06	Code
15	Active Exploration (Beam Search)	176.22	No	-	-	-
16	1111	45.13	No	-	-	-
17	Self-Supervised Auxiliary Reasoning Tasks (Beam Search)	40.85	No	Vision-Language Navigation with Self-Supervised ...	2019-11-18	-
18	no	22.14	No	-	-	-
19	Tactical Rewind - short	22.08	No	Tactical Rewind: Self-Correction via Backtrackin...	2019-03-06	Code
20	Single Run	21.03	No	-	-	-
21	SSM	20.39	No	-	-	-
22	VLN-TreeTrans	19.62	No	-	-	-
23	Self-Monitoring Navigation Agent (no beam search; Progress Inference)	18.04	No	Self-Monitoring Navigation Agent via Auxiliary P...	2019-01-10	Code
24	CCC(ssm)	16.94	No	-	-	-
25	selfmoni0	16.73	No	-	-	-
26	Hikari	16.44	No	-	-	-
27	sliu_team	16.41	No	-	-	-
28	Lily	16.14	No	-	-	-
29	DoubleAttn	16.03	No	-	-	-
30	WIN	15.9	No	-	-	-
31	WIN + RecVLN BERT	15.9	No	-	-	-
32	base_0	15.9	No	-	-	-
33	Single-Run, No Pre-Explore	15.89	No	-	-	-
34	BEVBert	15.87	No	-	-	-
35	single-run	15.83	No	-	-	-
36	base_1	15.75	No	-	-	-
37	liuer	15.74	No	-	-	-
38	HOC	15.47	No	-	-	-
39	ReadNet	15.24	No	-	-	-
40	fuse_1	15.1	No	-	-	-
41	GVLN	15.02	No	-	-	-
42	TD-STP	14.78	No	-	-	-
43	CVPR22	14.73	No	-	-	-
44	lxyict	14.6	No	-	-	-
45	GMap	14.43	No	-	-	-
46	testliu	14.42	No	-	-	-
47	DUET+PASTS	14.39	No	-	-	-
48	single run	14.31	No	-	-	-
49	Envdrop+SEVol+BT	14.29	No	-	-	-
50	metaexplore	14.25	No	-	-	-
51	SEA features + Speaker-Follower (single-run)	14.07	No	-	-	-
52	HAIL	13.85	No	-	-	-
53	DDL	13.75	No	-	-	-
54	The Regretful Agent (no beam search; greedy action selection)	13.69	No	The Regretful Agent: Heuristic-Aided Navigation ...	2019-03-05	Code
55	SEvol_lzy	13.57	No	-	-	-
56	DDL	13.55	No	-	-	-
57	Colab_buaa	13.54	No	-	-	-
58	zq	13.43	No	-	-	-
59	Environment-Agnostic Multitask Learning	13.35	No	Environment-agnostic Multitask Learning for Natu...	2020-03-01	Code
60	GBSE	13.2	No	-	-	-
61	CMG-AAL-TCSVT	13.16	No	-	-	-
62	single-run	13.11	No	Vision-Language Navigation with Random Environme...	2021-06-15	Code
63	Khanh Nguyen	13.08	No	-	-	-
64	VLN-BERT-Aug	13.07	No	-	-	-
65	a new baseline	13.07	No	-	-	-
66	licr19	13.05	No	-	-	-
67	Geo	13.02	No	-	-	-
68	SQANv1, No Pre-explore	13	No	-	-	-
69	MM2021	12.98	No	Neighbor-view Enhanced Model for Vision and Lang...	2021-07-15	Code
70	Single-Run	12.96	No	-	-	-
71	clin	12.84	No	-	-	-
72	YBYB	12.77	No	-	-	-
73	Fortest	12.75	No	-	-	-
74	hellohello	12.73	No	-	-	-
75	Single-Run	12.71	No	-	-	-
76	hellohellohello	12.62	No	-	-	-
77	single-run	12.6	No	-	-	-
78	ed	12.51	No	-	-	-
79	DCMT	12.51	No	-	-	-
80	Single-Run, No Pre-Explore	12.35	No	-	-	-
81	reg	12.35	No	-	-	-
82	ART	12.35	No	-	-	-
83	Single-Run, No Pre-Explore	12.34	No	-	-	-
84	PANDA-TingLiu	12.31	No	-	-	-
85	single-run	12.3	No	-	-	-
86	binbin	12.3	No	-	-	-
87	HAMT	12.27	No	-	-	-
88	coefficient	12.22	No	-	-	-
89	trysth	12.22	No	-	-	-
90	reward-vln	12.19	No	-	-	-
91	homebody	12.13	No	-	-	-
92	SERL	12.13	No	-	-	-
93	CMG-AAL	12.07	No	-	-	-
94	Reinforced Cross-Modal Matching (single trajectory; NO beam search)	11.97	No	-	-	-
95	bin	11.91	No	-	-	-
96	EnvEdit+PT	11.9	No	-	-	-
97	ESceme Single-run	11.89	No	-	-	-
98	CMC-AAL2	11.86	No	-	-	-
99	human	11.85	No	-	-	-
100	Single-run	11.79	No	-	-	-
101	map1	11.74	No	-	-	-
102	Back Translation with Environmental Dropout (no beam search)	11.66	No	Learning to Navigate Unseen Environments: Back T...	2019-04-08	Code
103	SERL (no_augmented)	11.47	No	-	-	-
104	OAG(without pre-explore, beam-search)	11.39	No	-	-	-
105	Single-Run, No Pre-Explore	11.15	No	-	-	-
106	test-sf	10.99	No	-	-	-
107	test_an	10.92	No	-	-	-
108	WQ_Pretrain	10.9	No	-	-	-
109	rcm_test	10.83	No	-	-	-
110	without pre-explore, beam-search	10.71	No	-	-	-
111	GraphBert	10.66	No	-	-	-
112	SYSU-ISE	10.65	No	-	-	-
113	jmebs	10.58	No	-	-	-
114	Greedy	10.52	No	-	-	-
115	PREVALENT	10.51	No	-	-	-
116	speaker_follower_tesk2	10.47	No	-	-	-
117	ai like samurai with PNasNet5Large	10.44	No	-	-	-
118	Self-Supervised Auxiliary Reasoning Tasks (Pre-explore)	10.43	No	Vision-Language Navigation with Self-Supervised ...	2019-11-18	-
119	naive	10.42	No	-	-	-
120	2m-path	10.4	No	-	-	-
121	SEA features + AuxRN (single-run)	10.31	No	-	-	-
122	Lang-Vis-Entity VLN (Single-Run)	10.29	No	-	-	-
123	ALTR	10.27	No	Transferable Representation Learning in Vision-a...	2019-08-09	-
124	Greedy, No Pre-explore	10.24	No	-	-	-
125	MARVAL	10.22	No	-	-	-
126	sponge	10.21	No	-	-	-
127	PREVALENT	10.21	No	-	-	-
128	Gloabl Normalization pre-explore	10.2	No	-	-	-
129	SEA features + Env-Dropout (single-run)	10.18	No	-	-	-
130	PTA	10.17	No	-	-	-
131	27k	10.06	No	-	-	-
132	single-run	10	No	-	-	-
133	zzzzzzzz55768	9.91	No	-	-	-
134	Random Agent	9.89	No	-	-	-
135	Active Exploration (Pre-explore)	9.85	No	-	-	-
136	Dynamic Convolutional Filters	9.81	No	-	-	-
137	Back Translation with Environmental Dropout (exploring unseen environments before testing)	9.79	No	-	-	-
138	zy123	9.56	No	-	-	-
139	SIL-R2	9.48	No	-	-	-
140	X-Modal	9.48	No	-	-	-
141	Look Before You Leap	9.15	No	-	-	-
142	AnonymousTeam	8.32	No	-	-	-
143	zhangyong	8.26	No	-	-	-
144	Seq2Seq Baseline	8.13	No	-	-	-
145	15458	0	No	-	-	-

#1Speaker-Follower
1257.38
length
No paper
#2FOAM-Beam Search
1250.89
length
No paper
#3null
1214.94
length
No paper
#4ADad
786.35
length
No paper
#5SERL (Beam_Search)
690.61
length
No paper
#6Global Normalization
686.86
length
No paper
#7nullSOTA
686.82
length· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout Code
#8VLN-Bert
686.62
length· 2020-04-30
Improving Vision-and-Language Navigation with Image-Text Pairs from the Web Code
#9Airbert
686.54
length· 2021-08-20
Airbert: In-domain Pretraining for Vision-and-Language Navigation Code
#10Lily
686.45
length
No paper
#11explore@40 beam-search
625.27
length
No paper
#12Self-Aware Co-Grounded Model
373.09
length
No paper
#13Reinforced Cross-Modal Matching (optimized for SR; with beam search)
357.62
length
No paper
#14Tactical Rewind - longSOTA
196.53
length· 2019-03-06
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation Code
#15Active Exploration (Beam Search)
176.22
length
No paper
#161111
45.13
length
No paper
#17Self-Supervised Auxiliary Reasoning Tasks (Beam Search)
40.85
length· 2019-11-18
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks
#18no
22.14
length
No paper
#19Tactical Rewind - short
22.08
length· 2019-03-06
Tactical Rewind: Self-Correction via Backtracking in Vision-and-Language Navigation Code
#20Single Run
21.03
length
No paper
#21SSM
20.39
length
No paper
#22VLN-TreeTrans
19.62
length
No paper
#23Self-Monitoring Navigation Agent (no beam search; Progress Inference)SOTA
18.04
length· 2019-01-10
Self-Monitoring Navigation Agent via Auxiliary Progress Estimation Code
#24CCC(ssm)
16.94
length
No paper
#25selfmoni0
16.73
length
No paper
#26Hikari
16.44
length
No paper
#27sliu_team
16.41
length
No paper
#28Lily
16.14
length
No paper
#29DoubleAttn
16.03
length
No paper
#30WIN
15.9
length
No paper
#31WIN + RecVLN BERT
15.9
length
No paper
#32base_0
15.9
length
No paper
#33Single-Run, No Pre-Explore
15.89
length
No paper
#34BEVBert
15.87
length
No paper
#35single-run
15.83
length
No paper
#36base_1
15.75
length
No paper
#37liuer
15.74
length
No paper
#38HOC
15.47
length
No paper
#39ReadNet
15.24
length
No paper
#40fuse_1
15.1
length
No paper
#41GVLN
15.02
length
No paper
#42TD-STP
14.78
length
No paper
#43CVPR22
14.73
length
No paper
#44lxyict
14.6
length
No paper
#45GMap
14.43
length
No paper
#46testliu
14.42
length
No paper
#47DUET+PASTS
14.39
length
No paper
#48single run
14.31
length
No paper
#49Envdrop+SEVol+BT
14.29
length
No paper
#50metaexplore
14.25
length
No paper
#51SEA features + Speaker-Follower (single-run)
14.07
length
No paper
#52HAIL
13.85
length
No paper
#53DDL
13.75
length
No paper
#54The Regretful Agent (no beam search; greedy action selection)
13.69
length· 2019-03-05
The Regretful Agent: Heuristic-Aided Navigation through Progress Estimation Code
#55SEvol_lzy
13.57
length
No paper
#56DDL
13.55
length
No paper
#57Colab_buaa
13.54
length
No paper
#58zq
13.43
length
No paper
#59Environment-Agnostic Multitask Learning
13.35
length· 2020-03-01
Environment-agnostic Multitask Learning for Natural Language Grounded Navigation Code
#60GBSE
13.2
length
No paper
#61CMG-AAL-TCSVT
13.16
length
No paper
#62single-run
13.11
length· 2021-06-15
Vision-Language Navigation with Random Environmental Mixup Code
#63Khanh Nguyen
13.08
length
No paper
#64VLN-BERT-Aug
13.07
length
No paper
#65a new baseline
13.07
length
No paper
#66licr19
13.05
length
No paper
#67Geo
13.02
length
No paper
#68SQANv1, No Pre-explore
13
length
No paper
#69MM2021
12.98
length· 2021-07-15
Neighbor-view Enhanced Model for Vision and Language Navigation Code
#70Single-Run
12.96
length
No paper
#71clin
12.84
length
No paper
#72YBYB
12.77
length
No paper
#73Fortest
12.75
length
No paper
#74hellohello
12.73
length
No paper
#75Single-Run
12.71
length
No paper
#76hellohellohello
12.62
length
No paper
#77single-run
12.6
length
No paper
#78ed
12.51
length
No paper
#79DCMT
12.51
length
No paper
#80Single-Run, No Pre-Explore
12.35
length
No paper
#81reg
12.35
length
No paper
#82ART
12.35
length
No paper
#83Single-Run, No Pre-Explore
12.34
length
No paper
#84PANDA-TingLiu
12.31
length
No paper
#85single-run
12.3
length
No paper
#86binbin
12.3
length
No paper
#87HAMT
12.27
length
No paper
#88coefficient
12.22
length
No paper
#89trysth
12.22
length
No paper
#90reward-vln
12.19
length
No paper
#91homebody
12.13
length
No paper
#92SERL
12.13
length
No paper
#93CMG-AAL
12.07
length
No paper
#94Reinforced Cross-Modal Matching (single trajectory; NO beam search)
11.97
length
No paper
#95bin
11.91
length
No paper
#96EnvEdit+PT
11.9
length
No paper
#97ESceme Single-run
11.89
length
No paper
#98CMC-AAL2
11.86
length
No paper
#99human
11.85
length
No paper
#100Single-run
11.79
length
No paper
#101map1
11.74
length
No paper
#102Back Translation with Environmental Dropout (no beam search)
11.66
length· 2019-04-08
Learning to Navigate Unseen Environments: Back Translation with Environmental Dropout Code
#103SERL (no_augmented)
11.47
length
No paper
#104OAG(without pre-explore, beam-search)
11.39
length
No paper
#105Single-Run, No Pre-Explore
11.15
length
No paper
#106test-sf
10.99
length
No paper
#107test_an
10.92
length
No paper
#108WQ_Pretrain
10.9
length
No paper
#109rcm_test
10.83
length
No paper
#110without pre-explore, beam-search
10.71
length
No paper
#111GraphBert
10.66
length
No paper
#112SYSU-ISE
10.65
length
No paper
#113jmebs
10.58
length
No paper
#114Greedy
10.52
length
No paper
#115PREVALENT
10.51
length
No paper
#116speaker_follower_tesk2
10.47
length
No paper
#117ai like samurai with PNasNet5Large
10.44
length
No paper
#118Self-Supervised Auxiliary Reasoning Tasks (Pre-explore)
10.43
length· 2019-11-18
Vision-Language Navigation with Self-Supervised Auxiliary Reasoning Tasks
#119naive
10.42
length
No paper
#1202m-path
10.4
length
No paper
#121SEA features + AuxRN (single-run)
10.31
length
No paper
#122Lang-Vis-Entity VLN (Single-Run)
10.29
length
No paper
#123ALTR
10.27
length· 2019-08-09
Transferable Representation Learning in Vision-and-Language Navigation
#124Greedy, No Pre-explore
10.24
length
No paper
#125MARVAL
10.22
length
No paper
#126sponge
10.21
length
No paper
#127PREVALENT
10.21
length
No paper
#128Gloabl Normalization pre-explore
10.2
length
No paper
#129SEA features + Env-Dropout (single-run)
10.18
length
No paper
#130PTA
10.17
length
No paper
#13127k
10.06
length
No paper
#132single-run
10
length
No paper
#133zzzzzzzz55768
9.91
length
No paper
#134Random Agent
9.89
length
No paper
#135Active Exploration (Pre-explore)
9.85
length
No paper
#136Dynamic Convolutional Filters
9.81
length
No paper
#137Back Translation with Environmental Dropout (exploring unseen environments before testing)
9.79
length
No paper
#138zy123
9.56
length
No paper
#139SIL-R2
9.48
length
No paper
#140X-Modal
9.48
length
No paper
#141Look Before You Leap
9.15
length
No paper
#142AnonymousTeam
8.32
length
No paper
#143zhangyong
8.26
length
No paper
#144Seq2Seq Baseline
8.13
length
No paper
#14515458
0
length
No paper