Description
PoolFormer is instantiated from MetaFormer by specifying the token mixer as extremely simple operator, pooling. PoolFormer is utilized as a tool to verify MetaFormer hypothesis "MetaFormer is actually what you need" (vs "Attention is all you need").
Papers Using This Method
DCFormer: Efficient 3D Vision-Language Modeling with Decomposed Convolutions2025-02-07GestFormer: Multiscale Wavelet Pooling Transformer Network for Dynamic Hand Gesture Recognition2024-05-18Spatiotemporal Pooling on Appropriate Topological Maps Represented as Two-Dimensional Images for EEG Classification2024-03-07Enhancing Transformer-Based Segmentation for Breast Cancer Diagnosis using Auto-Augmentation and Search Optimisation Techniques2023-11-18Advancing Ischemic Stroke Diagnosis: A Novel Two-Stage Approach for Blood Clot Origin Identification2023-04-26MetaFormer Baselines for Vision2022-10-24EfficientFormer: Vision Transformers at MobileNet Speed2022-06-02WaveMix: A Resource-efficient Neural Network for Image Analysis2022-05-28MetaFormer Is Actually What You Need for Vision2021-11-22