Keyword Spotting on QUESST

Metric: ATWV (higher is better)

LeaderboardDataset

Results

Sort:

#	Model↕	ATWV▼	Extra Data	Paper	Date↕	Code
1	CUHK(all the queries) System №2	0.412	No	-	-	-
2	CUHK(all the queries) System №1	0.412	No	-	-	-
3	SPL-IT(for the development set)	0.4051	No	-	-	-
4	ELiRF Fusion(All Queries)	0.3896	No	-	-	-
5	ELiRF Fusion+Length(All Queries)	0.3792	No	-	-	-
6	GTTS-EHU p (for the development set)	0.3567	No	-	-	-
7	NNI DTW(All Queries)	0.2918	No	-	-	-
8	NNI (dev)	0.286	No	-	-	-
9	NNI (eval)	0.27	No	-	-	-
10	NNI Symbolic(All Queries)	0.2696	No	-	-	-
11	NS-DTW(for the development set, all the queries)	0.2261	No	-	-	-
12	TUKE p-low late submission (for the development set)	0.191	No	-	-	-
13	TUKE p-low(for the development set)	0.161	No	-	-	-
14	ELiRF SDTW-avg (dev)	0.1446	No	-	-	-
15	ELiRF SDTW (dev)	0.1404	No	-	-	-
16	ELiRF SDTW-avg (eval)	0.1125	No	-	-	-
17	TUKE g-zero late submission(for the development set)	0.106	No	-	-	-
18	TUKE g-zero(for the development set)	0.091	No	-	-	-
19	IIT-B (dev)	0.0812	No	-	-	-
20	NNI non-filtered(for the development set)	0.0768	No	-	-	-
21	NNI Choi(for the development set)	0.0692	No	-	-	-
22	TUKE p-S late submission (dev)	0.055	No	-	-	-
23	TUKE p-S late submission (eval)	0.046	No	-	-	-
24	ELiRF SDTW (eval)	0.0449	No	-	-	-
25	TUKE g-U late submission (dev)	0.032	No	-	-	-
26	TUKE g-U late submission (eval)	0.028	No	-	-	-
27	IIT-B (eval)	0.0254	No	-	-	-
28	TUKE p-S (dev)	0.022	No	-	-	-
29	TUKE p-S (eval)	0.002	No	-	-	-
30	CUNY [SMO+iSAX] (dev)	0.0011	No	-	-	-
31	CUNY [SMO+iSAX] (eval)	0.0006	No	-	-	-
32	TUKE g-U (dev)	0.0001	No	-	-	-
33	TUKE g-U (eval)	-0.01	No	-	-	-
34	CUNY [Subseq+MFCC] (dev)	-3.982	No	-	-	-
35	CUNY [Subseq+MFCC] (eval)	-4.0205	No	-	-	-

#1CUHK(all the queries) System №2
0.412
ATWV
No paper
#2CUHK(all the queries) System №1
0.412
ATWV
No paper
#3SPL-IT(for the development set)
0.4051
ATWV
No paper
#4ELiRF Fusion(All Queries)
0.3896
ATWV
No paper
#5ELiRF Fusion+Length(All Queries)
0.3792
ATWV
No paper
#6GTTS-EHU p (for the development set)
0.3567
ATWV
No paper
#7NNI DTW(All Queries)
0.2918
ATWV
No paper
#8NNI (dev)
0.286
ATWV
No paper
#9NNI (eval)
0.27
ATWV
No paper
#10NNI Symbolic(All Queries)
0.2696
ATWV
No paper
#11NS-DTW(for the development set, all the queries)
0.2261
ATWV
No paper
#12TUKE p-low late submission (for the development set)
0.191
ATWV
No paper
#13TUKE p-low(for the development set)
0.161
ATWV
No paper
#14ELiRF SDTW-avg (dev)
0.1446
ATWV
No paper
#15ELiRF SDTW (dev)
0.1404
ATWV
No paper
#16ELiRF SDTW-avg (eval)
0.1125
ATWV
No paper
#17TUKE g-zero late submission(for the development set)
0.106
ATWV
No paper
#18TUKE g-zero(for the development set)
0.091
ATWV
No paper
#19IIT-B (dev)
0.0812
ATWV
No paper
#20NNI non-filtered(for the development set)
0.0768
ATWV
No paper
#21NNI Choi(for the development set)
0.0692
ATWV
No paper
#22TUKE p-S late submission (dev)
0.055
ATWV
No paper
#23TUKE p-S late submission (eval)
0.046
ATWV
No paper
#24ELiRF SDTW (eval)
0.0449
ATWV
No paper
#25TUKE g-U late submission (dev)
0.032
ATWV
No paper
#26TUKE g-U late submission (eval)
0.028
ATWV
No paper
#27IIT-B (eval)
0.0254
ATWV
No paper
#28TUKE p-S (dev)
0.022
ATWV
No paper
#29TUKE p-S (eval)
0.002
ATWV
No paper
#30CUNY [SMO+iSAX] (dev)
0.0011
ATWV
No paper
#31CUNY [SMO+iSAX] (eval)
0.0006
ATWV
No paper
#32TUKE g-U (dev)
0.0001
ATWV
No paper
#33TUKE g-U (eval)
-0.01
ATWV
No paper
#34CUNY [Subseq+MFCC] (dev)
-3.982
ATWV
No paper
#35CUNY [Subseq+MFCC] (eval)
-4.0205
ATWV
No paper