Conversational Web Navigation on WebLINX

Metric: Element (IoU) (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Element (IoU)▼	Extra Data	Paper	Date↕	Code
1	Llama-2-13B	22.82	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
2	S-LLaMA-2.7B	22.6	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
3	Llama-2-7B	22.26	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
4	S-LLaMA-1.3B	20.54	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
5	Flan-T5-3B	20.31	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
6	GPT-3.5F	18.64	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
7	MindAct-3B	16.5	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
8	Fuyu-8B	15.7	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
9	Flan-T5-780M	15.36	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
10	Flan-T5-250M	14.86	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
11	MindAct-780M	13.39	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
12	MindAct-250M	12.05	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
13	GPT-4V (Zero-Shot)	10.91	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
14	GPT-4T (Zero-Shot)	10.85	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
15	GPT-3.5T (Zero-Shot)	8.62	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
16	Pix2Act-1.3B	8.28	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
17	Pix2Act-282M	6.2	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code

#1Llama-2-13BSOTA
22.82
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#2S-LLaMA-2.7B
22.6
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#3Llama-2-7B
22.26
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#4S-LLaMA-1.3B
20.54
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#5Flan-T5-3B
20.31
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#6GPT-3.5F
18.64
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#7MindAct-3B
16.5
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#8Fuyu-8B
15.7
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#9Flan-T5-780M
15.36
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#10Flan-T5-250M
14.86
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#11MindAct-780M
13.39
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#12MindAct-250M
12.05
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#13GPT-4V (Zero-Shot)
10.91
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#14GPT-4T (Zero-Shot)
10.85
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#15GPT-3.5T (Zero-Shot)
8.62
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#16Pix2Act-1.3B
8.28
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#17Pix2Act-282M
6.2
Element (IoU)· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code