Keyword Spotting on QUESST

Metric: Cnxe (higher is better)

LeaderboardDataset

Results

Sort:

#	Model↕	Cnxe▼	Extra Data	Paper	Date↕	Code
1	NNI non-filtered(for the development set)	6.0905	No	-	-	-
2	NNI Choi(for the development set)	5.894	No	-	-	-
3	NTU dtw (eval)	2.0067	No	-	-	-
4	NTU rnn (eval)	2.0067	No	-	-	-
5	NTU dtw (dev)	2.0066	No	-	-	-
6	NTU rnn (dev)	2.0066	No	-	-	-
7	ELiRF SDTW (eval)	1.1879	No	-	-	-
8	ELiRF SDTW-avg (eval)	1.0731	No	-	-	-
9	ELiRF SDTW (dev)	1.0701	No	-	-	-
10	CUNY [Subseq+MFCC] (eval)	1.0674	No	-	-	-
11	CUNY [Subseq+MFCC] (dev)	1.0658	No	-	-	-
12	ELiRF SDTW-avg (dev)	1.0651	No	-	-	-
13	GTM-UVigo Contrastive (eval)	0.999	No	-	-	Code
14	CUNY [SMO+iSAX] (eval)	0.9989	No	-	-	-
15	CUNY [SMO+iSAX] (dev)	0.9988	No	-	-	-
16	GTM-UVigo Contrastive (dev)	0.998	No	-	-	Code
17	GTM-UVigo Contrastive late submission (eval)	0.989	No	-	-	Code
18	TUKE g-zero(for the development set)	0.974	No	-	-	-
19	TUKE g-U (dev)	0.974	No	-	-	-
20	TUKE g-U late submission (eval)	0.974	No	-	-	-
21	TUKE g-U (eval)	0.973	No	-	-	-
22	TUKE g-zero late submission(for the development set)	0.971	No	-	-	-
23	TUKE p-S (eval)	0.971	No	-	-	-
24	TUKE p-S (dev)	0.97	No	-	-	-
25	TUKE g-U late submission (dev)	0.97	No	-	-	-
26	TUKE p-S late submission (eval)	0.963	No	-	-	-
27	TUKE p-S late submission (dev)	0.962	No	-	-	-
28	TUKE p-low(for the development set)	0.96	No	-	-	-
29	IIT-B (eval)	0.9536	No	-	-	-
30	TUKE p-low late submission (for the development set)	0.948	No	-	-	-
31	IIT-B (dev)	0.9213	No	-	-	-
32	GTM-UVigo Primary (eval)	0.919	No	-	-	Code
33	BUT [l-fea stack DTW 3w+slope] (dev)	0.9188	No	-	-	-
34	GTM-UVigo Primary (dev)	0.917	No	-	-	Code
35	NS-DTW(for the development set, all the queries)	0.9121	No	-	-	-
36	GTM-UVigo Contrastive late submission (dev)	0.907	No	-	-	Code
37	BUT [l-fea stack DTW 2w+slope] (dev)	0.8884	No	-	-	-
38	BUT [l-fea stack DTW+slope] (dev)	0.8772	No	-	-	-
39	GTM-UVigo Primary late submission (dev)	0.875	No	-	-	Code
40	BUT [l-fea stack DTW+slope+2w3w fusion] (dev)	0.8731	No	-	-	-
41	GTM-UVigo Primary late submission (eval)	0.871	No	-	-	Code
42	BUT [p-fea stack DTW ] (dev)	0.858	No	-	-	-
43	BUT [l-fea stack DTW+slope] (eval)	0.849	No	-	-	-
44	BUT [p-fea stack DTW ] (eval)	0.8452	No	-	-	-
45	BUT [l-fea stack DTW+slope+2w3w fusion] (eval)	0.8447	No	-	-	-
46	SPL-IT-UC [Hmean, no side] (dev)	0.7957	No	-	-	-
47	SPL-IT-UC [All, no side] (eval)	0.793	No	-	-	-
48	SPL-IT-UC [Hmean, no side] (eval)	0.7914	No	-	-	-
49	SPL-IT-UC [All, no side] (dev)	0.7873	No	-	-	-
50	SPL-IT-UC [All + side-info] (eval)	0.7866	No	-	-	-
51	SPL-IT-UC [Hmean + side-info] (dev)	0.7862	No	-	-	-
52	SPL-IT-UC [Hmean + side-info] (eval)	0.7842	No	-	-	-
53	SPL-IT-UC [All + side-info] (dev)	0.7782	No	-	-	-
54	NNI (dev)	0.773	No	-	-	-
55	NNI (eval)	0.761	No	-	-	-
56	NNI Symbolic(All Queries)	0.7322	No	-	-	-
57	SPL-IT(for the development set)	0.7106	No	-	-	-
58	NNI DTW(All Queries)	0.6925	No	-	-	-
59	CUHK(all the queries) System №1	0.682	No	-	-	-
60	GTTS-EHU p (for the development set)	0.654	No	-	-	-
61	CUHK(all the queries) System №2	0.638	No	-	-	-
62	ELiRF Fusion(All Queries)	0.6125	No	-	-	-
63	ELiRF Fusion+Length(All Queries)	0.6023	No	-	-	-

#1NNI non-filtered(for the development set)
6.0905
Cnxe
No paper
#2NNI Choi(for the development set)
5.894
Cnxe
No paper
#3NTU dtw (eval)
2.0067
Cnxe
No paper
#4NTU rnn (eval)
2.0067
Cnxe
No paper
#5NTU dtw (dev)
2.0066
Cnxe
No paper
#6NTU rnn (dev)
2.0066
Cnxe
No paper
#7ELiRF SDTW (eval)
1.1879
Cnxe
No paper
#8ELiRF SDTW-avg (eval)
1.0731
Cnxe
No paper
#9ELiRF SDTW (dev)
1.0701
Cnxe
No paper
#10CUNY [Subseq+MFCC] (eval)
1.0674
Cnxe
No paper
#11CUNY [Subseq+MFCC] (dev)
1.0658
Cnxe
No paper
#12ELiRF SDTW-avg (dev)
1.0651
Cnxe
No paper
#13GTM-UVigo Contrastive (eval)
0.999
Cnxe
No paperCode
#14CUNY [SMO+iSAX] (eval)
0.9989
Cnxe
No paper
#15CUNY [SMO+iSAX] (dev)
0.9988
Cnxe
No paper
#16GTM-UVigo Contrastive (dev)
0.998
Cnxe
No paperCode
#17GTM-UVigo Contrastive late submission (eval)
0.989
Cnxe
No paperCode
#18TUKE g-zero(for the development set)
0.974
Cnxe
No paper
#19TUKE g-U (dev)
0.974
Cnxe
No paper
#20TUKE g-U late submission (eval)
0.974
Cnxe
No paper
#21TUKE g-U (eval)
0.973
Cnxe
No paper
#22TUKE g-zero late submission(for the development set)
0.971
Cnxe
No paper
#23TUKE p-S (eval)
0.971
Cnxe
No paper
#24TUKE p-S (dev)
0.97
Cnxe
No paper
#25TUKE g-U late submission (dev)
0.97
Cnxe
No paper
#26TUKE p-S late submission (eval)
0.963
Cnxe
No paper
#27TUKE p-S late submission (dev)
0.962
Cnxe
No paper
#28TUKE p-low(for the development set)
0.96
Cnxe
No paper
#29IIT-B (eval)
0.9536
Cnxe
No paper
#30TUKE p-low late submission (for the development set)
0.948
Cnxe
No paper
#31IIT-B (dev)
0.9213
Cnxe
No paper
#32GTM-UVigo Primary (eval)
0.919
Cnxe
No paperCode
#33BUT [l-fea stack DTW 3w+slope] (dev)
0.9188
Cnxe
No paper
#34GTM-UVigo Primary (dev)
0.917
Cnxe
No paperCode
#35NS-DTW(for the development set, all the queries)
0.9121
Cnxe
No paper
#36GTM-UVigo Contrastive late submission (dev)
0.907
Cnxe
No paperCode
#37BUT [l-fea stack DTW 2w+slope] (dev)
0.8884
Cnxe
No paper
#38BUT [l-fea stack DTW+slope] (dev)
0.8772
Cnxe
No paper
#39GTM-UVigo Primary late submission (dev)
0.875
Cnxe
No paperCode
#40BUT [l-fea stack DTW+slope+2w3w fusion] (dev)
0.8731
Cnxe
No paper
#41GTM-UVigo Primary late submission (eval)
0.871
Cnxe
No paperCode
#42BUT [p-fea stack DTW ] (dev)
0.858
Cnxe
No paper
#43BUT [l-fea stack DTW+slope] (eval)
0.849
Cnxe
No paper
#44BUT [p-fea stack DTW ] (eval)
0.8452
Cnxe
No paper
#45BUT [l-fea stack DTW+slope+2w3w fusion] (eval)
0.8447
Cnxe
No paper
#46SPL-IT-UC [Hmean, no side] (dev)
0.7957
Cnxe
No paper
#47SPL-IT-UC [All, no side] (eval)
0.793
Cnxe
No paper
#48SPL-IT-UC [Hmean, no side] (eval)
0.7914
Cnxe
No paper
#49SPL-IT-UC [All, no side] (dev)
0.7873
Cnxe
No paper
#50SPL-IT-UC [All + side-info] (eval)
0.7866
Cnxe
No paper
#51SPL-IT-UC [Hmean + side-info] (dev)
0.7862
Cnxe
No paper
#52SPL-IT-UC [Hmean + side-info] (eval)
0.7842
Cnxe
No paper
#53SPL-IT-UC [All + side-info] (dev)
0.7782
Cnxe
No paper
#54NNI (dev)
0.773
Cnxe
No paper
#55NNI (eval)
0.761
Cnxe
No paper
#56NNI Symbolic(All Queries)
0.7322
Cnxe
No paper
#57SPL-IT(for the development set)
0.7106
Cnxe
No paper
#58NNI DTW(All Queries)
0.6925
Cnxe
No paper
#59CUHK(all the queries) System №1
0.682
Cnxe
No paper
#60GTTS-EHU p (for the development set)
0.654
Cnxe
No paper
#61CUHK(all the queries) System №2
0.638
Cnxe
No paper
#62ELiRF Fusion(All Queries)
0.6125
Cnxe
No paper
#63ELiRF Fusion+Length(All Queries)
0.6023
Cnxe
No paper