Vision and Language Navigation on Touchdown Dataset

Metric: Task Completion (TC) (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	Task Completion (TC)▼	Extra Data	Paper	Date↕	Code
1	FLAME	40.2	No	FLAME: Learning to Navigate with Multimodal LLM ...	2024-08-20	Code
2	ORAR + junction type + heading delta	29.1	No	Analyzing Generalization of Vision and Language ...	2022-03-25	Code
3	ORAR	24.2	No	Analyzing Generalization of Vision and Language ...	2022-03-25	Code
4	ARC + L2STOP	16.68	No	Learning to Stop: A Simple yet Effective Approac...	2020-09-28	-
5	VLN Transformer +M-50 +style	16.2	Yes	Multimodal Text Style Transfer for Outdoor Visio...	2020-07-01	Code
6	VLN Transformer	14.9	No	Multimodal Text Style Transfer for Outdoor Visio...	2020-07-01	Code
7	ARC	14.13	No	Learning to Stop: A Simple yet Effective Approac...	2020-09-28	-
8	Retouch-RConcat	12.8	No	Retouchdown: Adding Touchdown to StreetLearn as ...	2020-01-10	Code
9	Gated Attention (GA)	11.9	No	Multimodal Text Style Transfer for Outdoor Visio...	2020-07-01	Code
10	RConcat	11.8	No	Multimodal Text Style Transfer for Outdoor Visio...	2020-07-01	Code
11	RConcat	10.7	No	Touchdown: Natural Language Navigation and Spati...	2018-11-29	Code
12	Gated Attention (GA)	5.5	No	Touchdown: Natural Language Navigation and Spati...	2018-11-29	Code

#1FLAMESOTA
40.2
Task Completion (TC)· 2024-08-20
FLAME: Learning to Navigate with Multimodal LLM in Urban Environments Code
#2ORAR + junction type + heading deltaSOTA
29.1
Task Completion (TC)· 2022-03-25
Analyzing Generalization of Vision and Language Navigation to Unseen Outdoor Areas Code
#3ORAR
24.2
Task Completion (TC)· 2022-03-25
Analyzing Generalization of Vision and Language Navigation to Unseen Outdoor Areas Code
#4ARC + L2STOPSOTA
16.68
Task Completion (TC)· 2020-09-28
Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation
#5VLN Transformer +M-50 +styleSOTA
16.2
Task Completion (TC)· Extra Data· 2020-07-01
Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation Code
#6VLN Transformer
14.9
Task Completion (TC)· 2020-07-01
Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation Code
#7ARC
14.13
Task Completion (TC)· 2020-09-28
Learning to Stop: A Simple yet Effective Approach to Urban Vision-Language Navigation
#8Retouch-RConcatSOTA
12.8
Task Completion (TC)· 2020-01-10
Retouchdown: Adding Touchdown to StreetLearn as a Shareable Resource for Language Grounding Tasks in Street View Code
#9Gated Attention (GA)
11.9
Task Completion (TC)· 2020-07-01
Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation Code
#10RConcat
11.8
Task Completion (TC)· 2020-07-01
Multimodal Text Style Transfer for Outdoor Vision-and-Language Navigation Code
#11RConcatSOTA
10.7
Task Completion (TC)· 2018-11-29
Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environments Code
#12Gated Attention (GA)
5.5
Task Completion (TC)· 2018-11-29
Touchdown: Natural Language Navigation and Spatial Reasoning in Visual Street Environments Code