Conversational Web Navigation on WebLINX

Metric: Intent Match (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Intent Match▼	Extra Data	Paper	Date↕	Code
1	S-LLaMA-2.7B	84	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
2	S-LLaMA-1.3B	83.32	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
3	Llama-2-7B	82.64	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
4	Llama-2-13B	81.91	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
5	Pix2Act-1.3B	81.8	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
6	Flan-T5-3B	81.14	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
7	Fuyu-8B	80.07	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
8	Flan-T5-780M	80.02	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
9	MindAct-3B	79.89	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
10	Pix2Act-282M	79.71	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
11	Flan-T5-250M	79.69	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
12	GPT-3.5F	77.56	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
13	MindAct-780M	75.87	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
14	MindAct-250M	74.25	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
15	GPT-3.5T (Zero-Shot)	42.77	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
16	GPT-4V (Zero-Shot)	42.36	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code
17	GPT-4T (Zero-Shot)	41.66	No	WebLINX: Real-World Website Navigation with Mult...	2024-02-08	Code

#1S-LLaMA-2.7BSOTA
84
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#2S-LLaMA-1.3B
83.32
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#3Llama-2-7B
82.64
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#4Llama-2-13B
81.91
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#5Pix2Act-1.3B
81.8
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#6Flan-T5-3B
81.14
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#7Fuyu-8B
80.07
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#8Flan-T5-780M
80.02
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#9MindAct-3B
79.89
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#10Pix2Act-282M
79.71
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#11Flan-T5-250M
79.69
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#12GPT-3.5F
77.56
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#13MindAct-780M
75.87
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#14MindAct-250M
74.25
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#15GPT-3.5T (Zero-Shot)
42.77
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#16GPT-4V (Zero-Shot)
42.36
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code
#17GPT-4T (Zero-Shot)
41.66
Intent Match· 2024-02-08
WebLINX: Real-World Website Navigation with Multi-Turn Dialogue Code