TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Parametric Scattering Networks

Parametric Scattering Networks

Shanel Gauthier, Benjamin Thérien, Laurent Alsène-Racicot, Muawiz Chaudhary, Irina Rish, Eugene Belilovsky, Michael Eickenberg, Guy Wolf

2021-07-20CVPR 2022 1Image ClassificationSmall Data Image Classification
PaperPDFCode(official)

Abstract

The wavelet scattering transform creates geometric invariants and deformation stability. In multiple signal domains, it has been shown to yield more discriminative representations compared to other non-learned representations and to outperform learned representations in certain tasks, particularly on limited labeled data and highly structured signals. The wavelet filters used in the scattering transform are typically selected to create a tight frame via a parameterized mother wavelet. In this work, we investigate whether this standard wavelet filterbank construction is optimal. Focusing on Morlet wavelets, we propose to learn the scales, orientations, and aspect ratios of the filters to produce problem-specific parameterizations of the scattering transform. We show that our learned versions of the scattering transform yield significant performance gains in small-sample classification settings over the standard scattering transform. Moreover, our empirical results suggest that traditional filterbank constructions may not always be necessary for scattering transforms to extract effective representations.

Results

TaskDatasetMetricValueModel
Image ClassificationCIFAR-10, 500 LabelsAccuracy (%)63.13LearnableScatteringNetwork+WRN
Image ClassificationCIFAR-10, 500 LabelsAccuracy (%)62.97WRN
Image ClassificationCIFAR-10, 500 LabelsAccuracy (%)61.66FixedScatteringNetwork+WRN
Image ClassificationCIFAR-10, 1000 LabelsAccuracy (%)71.37WRN
Image ClassificationCIFAR-10, 1000 LabelsAccuracy (%)70.14LearnableScatteringNetwork+WRN
Image ClassificationCIFAR-10, 1000 LabelsAccuracy (%)68.16FixedScatteringNetwork+WRN
Image ClassificationCIFAR-10, 100 LabelsAccuracy (%)43.6LearnableScatteringNetwork+WRN
Image ClassificationCIFAR-10, 100 LabelsAccuracy (%)43.16FixedScatteringNetwork+WRN
Image ClassificationCIFAR-10, 100 LabelsAccuracy (%)38.78WRN

Related Papers

Automatic Classification and Segmentation of Tunnel Cracks Based on Deep Learning and Visual Explanations2025-07-18Adversarial attacks to image classification systems using evolutionary algorithms2025-07-17Efficient Adaptation of Pre-trained Vision Transformer underpinned by Approximately Orthogonal Fine-Tuning Strategy2025-07-17Federated Learning for Commercial Image Sources2025-07-17MUPAX: Multidimensional Problem Agnostic eXplainable AI2025-07-17Hashed Watermark as a Filter: Defeating Forging and Overwriting Attacks in Weight-based Neural Network Watermarking2025-07-15Transferring Styles for Reduced Texture Bias and Improved Robustness in Semantic Segmentation Networks2025-07-14FedGSCA: Medical Federated Learning with Global Sample Selector and Client Adaptive Adjuster under Label Noise2025-07-13