Keyword Spotting on QUESST

Metric: MTWV (higher is better)

LeaderboardDataset

Results

Sort:

#	Model↕	MTWV▼	Extra Data	Paper	Date↕	Code
1	IIT-B (dev)	0.816	No	-	-	-
2	CUHK(all the queries) System №2	0.413	No	-	-	-
3	CUHK(all the queries) System №1	0.413	No	-	-	-
4	SPL-IT(for the development set)	0.4052	No	-	-	-
5	ELiRF Fusion(All Queries)	0.3952	No	-	-	-
6	ELiRF Fusion+Length(All Queries)	0.3801	No	-	-	-
7	GTTS-EHU p (for the development set)	0.3663	No	-	-	-
8	NNI DTW(All Queries)	0.2974	No	-	-	-
9	NNI (dev)	0.286	No	-	-	-
10	NNI (eval)	0.274	No	-	-	-
11	NNI Symbolic(All Queries)	0.2717	No	-	-	-
12	NS-DTW(for the development set, all the queries)	0.2263	No	-	-	-
13	TUKE p-low late submission (for the development set)	0.191	No	-	-	-
14	TUKE p-low(for the development set)	0.162	No	-	-	-
15	ELiRF SDTW-avg (dev)	0.1543	No	-	-	-
16	ELiRF SDTW (dev)	0.1493	No	-	-	-
17	ELiRF SDTW-avg (eval)	0.1181	No	-	-	-
18	TUKE g-zero late submission(for the development set)	0.107	No	-	-	-
19	TUKE g-zero(for the development set)	0.091	No	-	-	-
20	NNI non-filtered(for the development set)	0.0767	No	-	-	-
21	NNI Choi(for the development set)	0.0692	No	-	-	-
22	TUKE p-S late submission (dev)	0.059	No	-	-	-
23	ELiRF SDTW (eval)	0.0581	No	-	-	-
24	TUKE p-S late submission (eval)	0.049	No	-	-	-
25	IIT-B (eval)	0.0421	No	-	-	-
26	TUKE p-S (dev)	0.036	No	-	-	-
27	TUKE g-U late submission (dev)	0.035	No	-	-	-
28	TUKE g-U late submission (eval)	0.032	No	-	-	-
29	TUKE g-U (dev)	0.031	No	-	-	-
30	TUKE g-U (eval)	0.023	No	-	-	-
31	TUKE p-S (eval)	0.022	No	-	-	-
32	CUNY [Subseq+MFCC] (dev)	0.0123	No	-	-	-
33	CUNY [SMO+iSAX] (dev)	0.0067	No	-	-	-
34	CUNY [SMO+iSAX] (eval)	0.001	No	-	-	-
35	CUNY [Subseq+MFCC] (eval)	0.0006	No	-	-	-

#1IIT-B (dev)
0.816
MTWV
No paper
#2CUHK(all the queries) System №2
0.413
MTWV
No paper
#3CUHK(all the queries) System №1
0.413
MTWV
No paper
#4SPL-IT(for the development set)
0.4052
MTWV
No paper
#5ELiRF Fusion(All Queries)
0.3952
MTWV
No paper
#6ELiRF Fusion+Length(All Queries)
0.3801
MTWV
No paper
#7GTTS-EHU p (for the development set)
0.3663
MTWV
No paper
#8NNI DTW(All Queries)
0.2974
MTWV
No paper
#9NNI (dev)
0.286
MTWV
No paper
#10NNI (eval)
0.274
MTWV
No paper
#11NNI Symbolic(All Queries)
0.2717
MTWV
No paper
#12NS-DTW(for the development set, all the queries)
0.2263
MTWV
No paper
#13TUKE p-low late submission (for the development set)
0.191
MTWV
No paper
#14TUKE p-low(for the development set)
0.162
MTWV
No paper
#15ELiRF SDTW-avg (dev)
0.1543
MTWV
No paper
#16ELiRF SDTW (dev)
0.1493
MTWV
No paper
#17ELiRF SDTW-avg (eval)
0.1181
MTWV
No paper
#18TUKE g-zero late submission(for the development set)
0.107
MTWV
No paper
#19TUKE g-zero(for the development set)
0.091
MTWV
No paper
#20NNI non-filtered(for the development set)
0.0767
MTWV
No paper
#21NNI Choi(for the development set)
0.0692
MTWV
No paper
#22TUKE p-S late submission (dev)
0.059
MTWV
No paper
#23ELiRF SDTW (eval)
0.0581
MTWV
No paper
#24TUKE p-S late submission (eval)
0.049
MTWV
No paper
#25IIT-B (eval)
0.0421
MTWV
No paper
#26TUKE p-S (dev)
0.036
MTWV
No paper
#27TUKE g-U late submission (dev)
0.035
MTWV
No paper
#28TUKE g-U late submission (eval)
0.032
MTWV
No paper
#29TUKE g-U (dev)
0.031
MTWV
No paper
#30TUKE g-U (eval)
0.023
MTWV
No paper
#31TUKE p-S (eval)
0.022
MTWV
No paper
#32CUNY [Subseq+MFCC] (dev)
0.0123
MTWV
No paper
#33CUNY [SMO+iSAX] (dev)
0.0067
MTWV
No paper
#34CUNY [SMO+iSAX] (eval)
0.001
MTWV
No paper
#35CUNY [Subseq+MFCC] (eval)
0.0006
MTWV
No paper