Jee-weon Jung, Hee-Soo Heo, Hemlata Tak, Hye-jin Shim, Joon Son Chung, Bong-Jin Lee, Ha-Jin Yu, Nicholas Evans
Artefacts that differentiate spoofed from bona-fide utterances can reside in spectral or temporal domains. Their reliable detection usually depends upon computationally demanding ensemble systems where each subsystem is tuned to some specific artefacts. We seek to develop an efficient, single system that can detect a broad range of different spoofing attacks without score-level ensembles. We propose a novel heterogeneous stacking graph attention layer which models artefacts spanning heterogeneous temporal and spectral domains with a heterogeneous attention mechanism and a stack node. With a new max graph operation that involves a competitive mechanism and an extended readout scheme, our approach, named AASIST, outperforms the current state-of-the-art by 20% relative. Even a lightweight variant, AASIST-L, with only 85K parameters, outperforms all competing systems.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| 3D Reconstruction | ASVspoof 2021 | 21DF EER | 21.07 | AASIST |
| 3D Reconstruction | ASVspoof 2021 | 21LA EER | 11.46 | AASIST |
| Speaker Verification | ASVspoof 2021 | 21DF EER | 21.07 | AASIST |
| Speaker Verification | ASVspoof 2021 | 21LA EER | 11.46 | AASIST |
| 3D | ASVspoof 2021 | 21DF EER | 21.07 | AASIST |
| 3D | ASVspoof 2021 | 21LA EER | 11.46 | AASIST |
| DeepFake Detection | ASVspoof 2021 | 21DF EER | 21.07 | AASIST |
| DeepFake Detection | ASVspoof 2021 | 21LA EER | 11.46 | AASIST |
| Voice Anti-spoofing | ASVspoof 2019 - LA | min t-dcf | 0.0275 | AASIST |
| 3D Shape Reconstruction from Videos | ASVspoof 2021 | 21DF EER | 21.07 | AASIST |
| 3D Shape Reconstruction from Videos | ASVspoof 2021 | 21LA EER | 11.46 | AASIST |