Task-Oriented Dialogue Systems on KVRET

Metric: Entity F1 (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Entity F1▼	Extra Data	Paper	Date↕	Code
1	T5-3b(UnifiedSKG)	70.07	No	UnifiedSKG: Unifying and Multi-Tasking Structure...	2022-01-16	Code
2	COMET	63.6	No	Contextualize Knowledge Bases with Transformer f...	2020-10-12	-
3	DF-Net	62.5	No	Dynamic Fusion Network for Multi-Domain End-to-e...	2020-04-23	Code
4	GLMP	59.97	No	Global-to-local Memory Pointer Networks for Task...	2019-01-15	Code
5	TTOS	55.38	No	-	-	Code
6	KB-retriever	53.7	No	Entity-Consistent End-to-end Task-Oriented Dialo...	2019-09-15	Code
7	DSR	51.9	No	Sequence-to-Sequence Learning for Task-oriented ...	2018-06-12	-
8	KV Retrieval Net	48	No	Key-Value Retrieval Networks for Task-Oriented D...	2017-05-15	Code
9	THPN	37.8	No	-	-	Code
10	Mem2Seq	33.4	No	Mem2Seq: Effectively Incorporating Knowledge Bas...	2018-04-23	Code

#1T5-3b(UnifiedSKG)SOTA
70.07
Entity F1· 2022-01-16
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models Code
#2COMETSOTA
63.6
Entity F1· 2020-10-12
Contextualize Knowledge Bases with Transformer for End-to-end Task-Oriented Dialogue Systems
#3DF-NetSOTA
62.5
Entity F1· 2020-04-23
Dynamic Fusion Network for Multi-Domain End-to-end Task-Oriented Dialog Code
#4GLMPSOTA
59.97
Entity F1· 2019-01-15
Global-to-local Memory Pointer Networks for Task-Oriented Dialogue Code
#5TTOS
55.38
Entity F1
No paperCode
#6KB-retriever
53.7
Entity F1· 2019-09-15
Entity-Consistent End-to-end Task-Oriented Dialogue System with KB Retriever Code
#7DSRSOTA
51.9
Entity F1· 2018-06-12
Sequence-to-Sequence Learning for Task-oriented Dialogue with Dialogue State Representation
#8KV Retrieval NetSOTA
48
Entity F1· 2017-05-15
Key-Value Retrieval Networks for Task-Oriented Dialogue Code
#9THPN
37.8
Entity F1
No paperCode
#10Mem2Seq
33.4
Entity F1· 2018-04-23
Mem2Seq: Effectively Incorporating Knowledge Bases into End-to-End Task-Oriented Dialog Systems Code