Chieh-Hsin Lai, Dongmian Zou, Gilad Lerman
We propose a neural network for unsupervised anomaly detection with a novel robust subspace recovery layer (RSR layer). This layer seeks to extract the underlying subspace from a latent representation of the given data and removes outliers that lie away from this subspace. It is used within an autoencoder. The encoder maps the data into a latent space, from which the RSR layer extracts the subspace. The decoder then smoothly maps back the underlying subspace to a "manifold" close to the original inliers. Inliers and outliers are distinguished according to the distances between the original and mapped positions (small for inliers and large for outliers). Extensive numerical experiments with both image and document datasets demonstrate state-of-the-art precision and recall.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Anomaly Detection | 20NEWS | AUC (outlier ratio = 0.5) | 0.831 | RSRAE |
| Anomaly Detection | Reuters-21578 | AUC (outlier ratio = 0.5) | 0.849 | RSRAE |
| Anomaly Detection | Caltech-101 | AUC (outlier ratio = 0.5) | 0.772 | RSRAE |
| Anomaly Detection | Fashion-MNIST | AUC (outlier ratio = 0.5) | 0.833 | RSRAE |
| Anomaly Detection | ASSIRA Cat Vs Dog | AUC-ROC | 0.835 | RSRAE |
| Anomaly Detection | STL-10 | AUC-ROC | 0.944 | RSRAE |
| Anomaly Detection | CIFAR-10 | AUC-ROC | 0.739 | RSRAE |
| Anomaly Detection | Fashion-MNIST | AUC-ROC | 0.689 | RSRAE |
| Anomaly Detection | MNIST | AUC-ROC | 0.763 | RSRAE |
| Unsupervised Anomaly Detection | 20NEWS | AUC (outlier ratio = 0.5) | 0.831 | RSRAE |
| Unsupervised Anomaly Detection | Reuters-21578 | AUC (outlier ratio = 0.5) | 0.849 | RSRAE |
| Unsupervised Anomaly Detection | Caltech-101 | AUC (outlier ratio = 0.5) | 0.772 | RSRAE |
| Unsupervised Anomaly Detection | Fashion-MNIST | AUC (outlier ratio = 0.5) | 0.833 | RSRAE |
| Unsupervised Anomaly Detection | ASSIRA Cat Vs Dog | AUC-ROC | 0.835 | RSRAE |
| Unsupervised Anomaly Detection | STL-10 | AUC-ROC | 0.944 | RSRAE |
| Unsupervised Anomaly Detection | CIFAR-10 | AUC-ROC | 0.739 | RSRAE |
| Unsupervised Anomaly Detection | Fashion-MNIST | AUC-ROC | 0.689 | RSRAE |
| Unsupervised Anomaly Detection | MNIST | AUC-ROC | 0.763 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 20% anomaly | Cats and Dogs | AUC-ROC | 0.917 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 20% anomaly | cifar10 | AUC-ROC | 0.814 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 20% anomaly | MNIST | AUC-ROC | 0.794 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 20% anomaly | Fashion-MNIST | AUC-ROC | 0.689 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 20% anomaly | STL-10 | AUC-ROC | 0.971 | RSARE |
| Unsupervised Anomaly Detection with Specified Settings -- 30% anomaly | ASSIRA Cat Vs Dog | AUC-ROC | 0.835 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 30% anomaly | STL-10 | AUC-ROC | 0.944 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 30% anomaly | CIFAR-10 | AUC-ROC | 0.739 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 30% anomaly | Fashion-MNIST | AUC-ROC | 0.689 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 30% anomaly | MNIST | AUC-ROC | 0.763 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 1% anomaly | STL-10 | AUC-ROC | 0.992 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 1% anomaly | MNIST | AUC-ROC | 0.948 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 1% anomaly | CIFAR-10 | AUC-ROC | 0.911 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 1% anomaly | Cats and Dogs | AUC-ROC | 0.981 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 1% anomaly | Fashion-MNIST | AUC-ROC | 0.854 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 0.1% anomaly | MNIST | AUC-ROC | 0.966 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 0.1% anomaly | STL-10 | AUC-ROC | 0.995 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 0.1% anomaly | CIFAR-10 | AUC-ROC | 0.901 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 0.1% anomaly | Cats and Dogs | AUC-ROC | 0.982 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 0.1% anomaly | Fashion-MNIST | AUC-ROC | 0.9 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 10% anomaly | Fashion-MNIST | AUC-ROC | 0.748 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 10% anomaly | CIFAR-10 | AUC-ROC | 0.8 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 10% anomaly | MNIST | AUC-ROC | 0.851 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 10% anomaly | STL-10 | AUC-ROC | 0.972 | RSRAE |
| Unsupervised Anomaly Detection with Specified Settings -- 10% anomaly | Cats and Dogs | AUC-ROC | 0.961 | RSRAE |