TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/The Art of Camouflage: Few-Shot Learning for Animal Detect...

The Art of Camouflage: Few-Shot Learning for Animal Detection and Segmentation

Thanh-Danh Nguyen, Anh-Khoa Nguyen Vu, Nhat-Duy Nguyen, Vinh-Tiep Nguyen, Thanh Duc Ngo, Thanh-Toan Do, Minh-Triet Tran, Tam V. Nguyen

2023-04-15Few-Shot LearningFew-Shot Object DetectionCamouflaged Object SegmentationObject DetectionFew-shot Instance Segmentation
PaperPDFCode(official)

Abstract

Camouflaged object detection and segmentation is a new and challenging research topic in computer vision. There is a serious issue of lacking data on concealed objects such as camouflaged animals in natural scenes. In this paper, we address the problem of few-shot learning for camouflaged object detection and segmentation. To this end, we first collect a new dataset, CAMO-FS, for the benchmark. As camouflaged instances are challenging to recognize due to their similarity compared to the surroundings, we guide our models to obtain camouflaged features that highly distinguish the instances from the background. In this work, we propose FS-CDIS, a framework to efficiently detect and segment camouflaged instances via two loss functions contributing to the training process. Firstly, the instance triplet loss with the characteristic of differentiating the anchor, which is the mean of all camouflaged foreground points, and the background points are employed to work at the instance level. Secondly, to consolidate the generalization at the class level, we present instance memory storage with the scope of storing camouflaged features of the same category, allowing the model to capture further class-level information during the learning process. The extensive experiments demonstrated that our proposed method achieves state-of-the-art performance on the newly collected dataset. Code is available at https://github.com/danhntd/FS-CDIS.

Results

TaskDatasetMetricValueModel
Object DetectionCAMO-FSbox AP10.36FS-CDIS (MTFA+IMS 5-shot)
Object DetectionCAMO-FSbox AP10.36FS-CDIS (Res101-MTFA+IMS 5-shot)
Object DetectionCAMO-FSbox AP10.36FS-CDIS (iFS-RCNN+ITL 5-shot)
Object DetectionCAMO-FSbox AP9.76FS-CDIS (Res101-MTFA+ITL 5-shot)
Object DetectionCAMO-FSbox AP9.67FS-CDIS (M-RCNN+ITL 5-shot)
Object DetectionCAMO-FSbox AP9.52FS-CDIS (M-RCNN+IMS 5-shot)
Object DetectionCAMO-FSbox AP8.44FS-CDIS (iFS-RCNN+IMS 5-shot)
Object DetectionCAMO-FSbox AP7.96FS-CDIS (M-RCNN+IMS 3-shot)
Object DetectionCAMO-FSbox AP7.85FS-CDIS (M-RCNN+ITL 3-shot)
Object DetectionCAMO-FSbox AP7.56FS-CDIS (M-RCNN+ITL 2-shot)
Object DetectionCAMO-FSbox AP7.55FS-CDIS (MTFA+IMS 3-shot)
Object DetectionCAMO-FSbox AP7.55FS-CDIS (Res101-MTFA+IMS 3-shot)
Object DetectionCAMO-FSbox AP7.39FS-CDIS (M-RCNN+IMS 2-shot)
Object DetectionCAMO-FSbox AP7.28FS-CDIS (Res101-MTFA+ITL 2-shot)
Object DetectionCAMO-FSbox AP7.1FS-CDIS (iFS-RCNN+ITL 3-shot)
Object DetectionCAMO-FSbox AP6.95FS-CDIS (MTFA+IMS 2-shot)
Object DetectionCAMO-FSbox AP6.95FS-CDIS (Res101-MTFA+IMS 2-shot)
Object DetectionCAMO-FSbox AP6.39FS-CDIS (iFS-RCNN+IMS 2-shot)
Object DetectionCAMO-FSbox AP5.94FS-CDIS (iFS-RCNN+IMS 3-shot)
Object DetectionCAMO-FSbox AP5.66FS-CDIS (iFS-RCNN+ITL 2-shot)
Object DetectionCAMO-FSbox AP5.08FS-CDIS (M-RCNN+ITL 1-shot)
Object DetectionCAMO-FSbox AP4.92FS-CDIS (M-RCNN+IMS 1-shot)
Object DetectionCAMO-FSbox AP4.71FS-CDIS (iFS-RCNN+ITL 1-shot)
Object DetectionCAMO-FSbox AP4.5FS-CDIS (MTFA+IMS 1-shot)
Object DetectionCAMO-FSbox AP4.04FS-CDIS (Res101-MTFA+ITL 1-shot)
Object DetectionCAMO-FSbox AP2.74FS-CDIS (iFS-RCNN+IMS 1-shot)
3DCAMO-FSbox AP10.36FS-CDIS (MTFA+IMS 5-shot)
3DCAMO-FSbox AP10.36FS-CDIS (Res101-MTFA+IMS 5-shot)
3DCAMO-FSbox AP10.36FS-CDIS (iFS-RCNN+ITL 5-shot)
3DCAMO-FSbox AP9.76FS-CDIS (Res101-MTFA+ITL 5-shot)
3DCAMO-FSbox AP9.67FS-CDIS (M-RCNN+ITL 5-shot)
3DCAMO-FSbox AP9.52FS-CDIS (M-RCNN+IMS 5-shot)
3DCAMO-FSbox AP8.44FS-CDIS (iFS-RCNN+IMS 5-shot)
3DCAMO-FSbox AP7.96FS-CDIS (M-RCNN+IMS 3-shot)
3DCAMO-FSbox AP7.85FS-CDIS (M-RCNN+ITL 3-shot)
3DCAMO-FSbox AP7.56FS-CDIS (M-RCNN+ITL 2-shot)
3DCAMO-FSbox AP7.55FS-CDIS (MTFA+IMS 3-shot)
3DCAMO-FSbox AP7.55FS-CDIS (Res101-MTFA+IMS 3-shot)
3DCAMO-FSbox AP7.39FS-CDIS (M-RCNN+IMS 2-shot)
3DCAMO-FSbox AP7.28FS-CDIS (Res101-MTFA+ITL 2-shot)
3DCAMO-FSbox AP7.1FS-CDIS (iFS-RCNN+ITL 3-shot)
3DCAMO-FSbox AP6.95FS-CDIS (MTFA+IMS 2-shot)
3DCAMO-FSbox AP6.95FS-CDIS (Res101-MTFA+IMS 2-shot)
3DCAMO-FSbox AP6.39FS-CDIS (iFS-RCNN+IMS 2-shot)
3DCAMO-FSbox AP5.94FS-CDIS (iFS-RCNN+IMS 3-shot)
3DCAMO-FSbox AP5.66FS-CDIS (iFS-RCNN+ITL 2-shot)
3DCAMO-FSbox AP5.08FS-CDIS (M-RCNN+ITL 1-shot)
3DCAMO-FSbox AP4.92FS-CDIS (M-RCNN+IMS 1-shot)
3DCAMO-FSbox AP4.71FS-CDIS (iFS-RCNN+ITL 1-shot)
3DCAMO-FSbox AP4.5FS-CDIS (MTFA+IMS 1-shot)
3DCAMO-FSbox AP4.04FS-CDIS (Res101-MTFA+ITL 1-shot)
3DCAMO-FSbox AP2.74FS-CDIS (iFS-RCNN+IMS 1-shot)
Few-Shot Object DetectionCAMO-FSbox AP10.36FS-CDIS (MTFA+IMS 5-shot)
Few-Shot Object DetectionCAMO-FSbox AP10.36FS-CDIS (Res101-MTFA+IMS 5-shot)
Few-Shot Object DetectionCAMO-FSbox AP10.36FS-CDIS (iFS-RCNN+ITL 5-shot)
Few-Shot Object DetectionCAMO-FSbox AP9.76FS-CDIS (Res101-MTFA+ITL 5-shot)
Few-Shot Object DetectionCAMO-FSbox AP9.67FS-CDIS (M-RCNN+ITL 5-shot)
Few-Shot Object DetectionCAMO-FSbox AP9.52FS-CDIS (M-RCNN+IMS 5-shot)
Few-Shot Object DetectionCAMO-FSbox AP8.44FS-CDIS (iFS-RCNN+IMS 5-shot)
Few-Shot Object DetectionCAMO-FSbox AP7.96FS-CDIS (M-RCNN+IMS 3-shot)
Few-Shot Object DetectionCAMO-FSbox AP7.85FS-CDIS (M-RCNN+ITL 3-shot)
Few-Shot Object DetectionCAMO-FSbox AP7.56FS-CDIS (M-RCNN+ITL 2-shot)
Few-Shot Object DetectionCAMO-FSbox AP7.55FS-CDIS (MTFA+IMS 3-shot)
Few-Shot Object DetectionCAMO-FSbox AP7.55FS-CDIS (Res101-MTFA+IMS 3-shot)
Few-Shot Object DetectionCAMO-FSbox AP7.39FS-CDIS (M-RCNN+IMS 2-shot)
Few-Shot Object DetectionCAMO-FSbox AP7.28FS-CDIS (Res101-MTFA+ITL 2-shot)
Few-Shot Object DetectionCAMO-FSbox AP7.1FS-CDIS (iFS-RCNN+ITL 3-shot)
Few-Shot Object DetectionCAMO-FSbox AP6.95FS-CDIS (MTFA+IMS 2-shot)
Few-Shot Object DetectionCAMO-FSbox AP6.95FS-CDIS (Res101-MTFA+IMS 2-shot)
Few-Shot Object DetectionCAMO-FSbox AP6.39FS-CDIS (iFS-RCNN+IMS 2-shot)
Few-Shot Object DetectionCAMO-FSbox AP5.94FS-CDIS (iFS-RCNN+IMS 3-shot)
Few-Shot Object DetectionCAMO-FSbox AP5.66FS-CDIS (iFS-RCNN+ITL 2-shot)
Few-Shot Object DetectionCAMO-FSbox AP5.08FS-CDIS (M-RCNN+ITL 1-shot)
Few-Shot Object DetectionCAMO-FSbox AP4.92FS-CDIS (M-RCNN+IMS 1-shot)
Few-Shot Object DetectionCAMO-FSbox AP4.71FS-CDIS (iFS-RCNN+ITL 1-shot)
Few-Shot Object DetectionCAMO-FSbox AP4.5FS-CDIS (MTFA+IMS 1-shot)
Few-Shot Object DetectionCAMO-FSbox AP4.04FS-CDIS (Res101-MTFA+ITL 1-shot)
Few-Shot Object DetectionCAMO-FSbox AP2.74FS-CDIS (iFS-RCNN+IMS 1-shot)
2D Semantic SegmentationCAMO-FSmask AP9.82FS-CDIS (M-RCNN+IMS 5-shot)
2D Semantic SegmentationCAMO-FSmask AP9.61FS-CDIS (MTFA+IMS 5-shot)
2D Semantic SegmentationCAMO-FSmask AP9.35FS-CDIS (M-RCNN+ITL 5-shot)
2D Semantic SegmentationCAMO-FSmask AP9.03FS-CDIS (iFS-RCNN+IMS 5-shot)
2D Semantic SegmentationCAMO-FSmask AP8.65FS-CDIS (M-RCNN+IMS 3-shot)
2D Semantic SegmentationCAMO-FSmask AP8.48FS-CDIS (Res101-MTFA+ITL 1-shot)
2D Semantic SegmentationCAMO-FSmask AP7.84FS-CDIS (M-RCNN+IMS 2-shot)
2D Semantic SegmentationCAMO-FSmask AP7.36FS-CDIS (MTFA+IMS 3-shot)
2D Semantic SegmentationCAMO-FSmask AP6.95FS-CDIS (MTFA+IMS 2-shot)
2D Semantic SegmentationCAMO-FSmask AP6.83FS-CDIS (iFS-RCNN+IMS 2-shot)
2D Semantic SegmentationCAMO-FSmask AP6.14FS-CDIS (iFS-RCNN+IMS 3-shot)
2D Semantic SegmentationCAMO-FSmask AP6.01FS-CDIS (M-RCNN+ITL 2-shot)
2D Semantic SegmentationCAMO-FSmask AP5.46FS-CDIS (MTFA+IMS 1-shot)
2D Semantic SegmentationCAMO-FSmask AP5.35FS-CDIS (M-RCNN+ITL 1-shot)
2D Semantic SegmentationCAMO-FSmask AP2.99FS-CDIS (iFS-RCNN+IMS 1-shot)
2D ClassificationCAMO-FSbox AP10.36FS-CDIS (MTFA+IMS 5-shot)
2D ClassificationCAMO-FSbox AP10.36FS-CDIS (Res101-MTFA+IMS 5-shot)
2D ClassificationCAMO-FSbox AP10.36FS-CDIS (iFS-RCNN+ITL 5-shot)
2D ClassificationCAMO-FSbox AP9.76FS-CDIS (Res101-MTFA+ITL 5-shot)
2D ClassificationCAMO-FSbox AP9.67FS-CDIS (M-RCNN+ITL 5-shot)
2D ClassificationCAMO-FSbox AP9.52FS-CDIS (M-RCNN+IMS 5-shot)
2D ClassificationCAMO-FSbox AP8.44FS-CDIS (iFS-RCNN+IMS 5-shot)
2D ClassificationCAMO-FSbox AP7.96FS-CDIS (M-RCNN+IMS 3-shot)
2D ClassificationCAMO-FSbox AP7.85FS-CDIS (M-RCNN+ITL 3-shot)
2D ClassificationCAMO-FSbox AP7.56FS-CDIS (M-RCNN+ITL 2-shot)
2D ClassificationCAMO-FSbox AP7.55FS-CDIS (MTFA+IMS 3-shot)
2D ClassificationCAMO-FSbox AP7.55FS-CDIS (Res101-MTFA+IMS 3-shot)
2D ClassificationCAMO-FSbox AP7.39FS-CDIS (M-RCNN+IMS 2-shot)
2D ClassificationCAMO-FSbox AP7.28FS-CDIS (Res101-MTFA+ITL 2-shot)
2D ClassificationCAMO-FSbox AP7.1FS-CDIS (iFS-RCNN+ITL 3-shot)
2D ClassificationCAMO-FSbox AP6.95FS-CDIS (MTFA+IMS 2-shot)
2D ClassificationCAMO-FSbox AP6.95FS-CDIS (Res101-MTFA+IMS 2-shot)
2D ClassificationCAMO-FSbox AP6.39FS-CDIS (iFS-RCNN+IMS 2-shot)
2D ClassificationCAMO-FSbox AP5.94FS-CDIS (iFS-RCNN+IMS 3-shot)
2D ClassificationCAMO-FSbox AP5.66FS-CDIS (iFS-RCNN+ITL 2-shot)
2D ClassificationCAMO-FSbox AP5.08FS-CDIS (M-RCNN+ITL 1-shot)
2D ClassificationCAMO-FSbox AP4.92FS-CDIS (M-RCNN+IMS 1-shot)
2D ClassificationCAMO-FSbox AP4.71FS-CDIS (iFS-RCNN+ITL 1-shot)
2D ClassificationCAMO-FSbox AP4.5FS-CDIS (MTFA+IMS 1-shot)
2D ClassificationCAMO-FSbox AP4.04FS-CDIS (Res101-MTFA+ITL 1-shot)
2D ClassificationCAMO-FSbox AP2.74FS-CDIS (iFS-RCNN+IMS 1-shot)
2D Object DetectionCAMO-FSbox AP10.36FS-CDIS (MTFA+IMS 5-shot)
2D Object DetectionCAMO-FSbox AP10.36FS-CDIS (Res101-MTFA+IMS 5-shot)
2D Object DetectionCAMO-FSbox AP10.36FS-CDIS (iFS-RCNN+ITL 5-shot)
2D Object DetectionCAMO-FSbox AP9.76FS-CDIS (Res101-MTFA+ITL 5-shot)
2D Object DetectionCAMO-FSbox AP9.67FS-CDIS (M-RCNN+ITL 5-shot)
2D Object DetectionCAMO-FSbox AP9.52FS-CDIS (M-RCNN+IMS 5-shot)
2D Object DetectionCAMO-FSbox AP8.44FS-CDIS (iFS-RCNN+IMS 5-shot)
2D Object DetectionCAMO-FSbox AP7.96FS-CDIS (M-RCNN+IMS 3-shot)
2D Object DetectionCAMO-FSbox AP7.85FS-CDIS (M-RCNN+ITL 3-shot)
2D Object DetectionCAMO-FSbox AP7.56FS-CDIS (M-RCNN+ITL 2-shot)
2D Object DetectionCAMO-FSbox AP7.55FS-CDIS (MTFA+IMS 3-shot)
2D Object DetectionCAMO-FSbox AP7.55FS-CDIS (Res101-MTFA+IMS 3-shot)
2D Object DetectionCAMO-FSbox AP7.39FS-CDIS (M-RCNN+IMS 2-shot)
2D Object DetectionCAMO-FSbox AP7.28FS-CDIS (Res101-MTFA+ITL 2-shot)
2D Object DetectionCAMO-FSbox AP7.1FS-CDIS (iFS-RCNN+ITL 3-shot)
2D Object DetectionCAMO-FSbox AP6.95FS-CDIS (MTFA+IMS 2-shot)
2D Object DetectionCAMO-FSbox AP6.95FS-CDIS (Res101-MTFA+IMS 2-shot)
2D Object DetectionCAMO-FSbox AP6.39FS-CDIS (iFS-RCNN+IMS 2-shot)
2D Object DetectionCAMO-FSbox AP5.94FS-CDIS (iFS-RCNN+IMS 3-shot)
2D Object DetectionCAMO-FSbox AP5.66FS-CDIS (iFS-RCNN+ITL 2-shot)
2D Object DetectionCAMO-FSbox AP5.08FS-CDIS (M-RCNN+ITL 1-shot)
2D Object DetectionCAMO-FSbox AP4.92FS-CDIS (M-RCNN+IMS 1-shot)
2D Object DetectionCAMO-FSbox AP4.71FS-CDIS (iFS-RCNN+ITL 1-shot)
2D Object DetectionCAMO-FSbox AP4.5FS-CDIS (MTFA+IMS 1-shot)
2D Object DetectionCAMO-FSbox AP4.04FS-CDIS (Res101-MTFA+ITL 1-shot)
2D Object DetectionCAMO-FSbox AP2.74FS-CDIS (iFS-RCNN+IMS 1-shot)
Image SegmentationCAMO-FSmask AP9.82FS-CDIS (M-RCNN+IMS 5-shot)
Image SegmentationCAMO-FSmask AP9.61FS-CDIS (MTFA+IMS 5-shot)
Image SegmentationCAMO-FSmask AP9.35FS-CDIS (M-RCNN+ITL 5-shot)
Image SegmentationCAMO-FSmask AP9.03FS-CDIS (iFS-RCNN+IMS 5-shot)
Image SegmentationCAMO-FSmask AP8.65FS-CDIS (M-RCNN+IMS 3-shot)
Image SegmentationCAMO-FSmask AP8.48FS-CDIS (Res101-MTFA+ITL 1-shot)
Image SegmentationCAMO-FSmask AP7.84FS-CDIS (M-RCNN+IMS 2-shot)
Image SegmentationCAMO-FSmask AP7.36FS-CDIS (MTFA+IMS 3-shot)
Image SegmentationCAMO-FSmask AP6.95FS-CDIS (MTFA+IMS 2-shot)
Image SegmentationCAMO-FSmask AP6.83FS-CDIS (iFS-RCNN+IMS 2-shot)
Image SegmentationCAMO-FSmask AP6.14FS-CDIS (iFS-RCNN+IMS 3-shot)
Image SegmentationCAMO-FSmask AP6.01FS-CDIS (M-RCNN+ITL 2-shot)
Image SegmentationCAMO-FSmask AP5.46FS-CDIS (MTFA+IMS 1-shot)
Image SegmentationCAMO-FSmask AP5.35FS-CDIS (M-RCNN+ITL 1-shot)
Image SegmentationCAMO-FSmask AP2.99FS-CDIS (iFS-RCNN+IMS 1-shot)
16kCAMO-FSbox AP10.36FS-CDIS (MTFA+IMS 5-shot)
16kCAMO-FSbox AP10.36FS-CDIS (Res101-MTFA+IMS 5-shot)
16kCAMO-FSbox AP10.36FS-CDIS (iFS-RCNN+ITL 5-shot)
16kCAMO-FSbox AP9.76FS-CDIS (Res101-MTFA+ITL 5-shot)
16kCAMO-FSbox AP9.67FS-CDIS (M-RCNN+ITL 5-shot)
16kCAMO-FSbox AP9.52FS-CDIS (M-RCNN+IMS 5-shot)
16kCAMO-FSbox AP8.44FS-CDIS (iFS-RCNN+IMS 5-shot)
16kCAMO-FSbox AP7.96FS-CDIS (M-RCNN+IMS 3-shot)
16kCAMO-FSbox AP7.85FS-CDIS (M-RCNN+ITL 3-shot)
16kCAMO-FSbox AP7.56FS-CDIS (M-RCNN+ITL 2-shot)
16kCAMO-FSbox AP7.55FS-CDIS (MTFA+IMS 3-shot)
16kCAMO-FSbox AP7.55FS-CDIS (Res101-MTFA+IMS 3-shot)
16kCAMO-FSbox AP7.39FS-CDIS (M-RCNN+IMS 2-shot)
16kCAMO-FSbox AP7.28FS-CDIS (Res101-MTFA+ITL 2-shot)
16kCAMO-FSbox AP7.1FS-CDIS (iFS-RCNN+ITL 3-shot)
16kCAMO-FSbox AP6.95FS-CDIS (MTFA+IMS 2-shot)
16kCAMO-FSbox AP6.95FS-CDIS (Res101-MTFA+IMS 2-shot)
16kCAMO-FSbox AP6.39FS-CDIS (iFS-RCNN+IMS 2-shot)
16kCAMO-FSbox AP5.94FS-CDIS (iFS-RCNN+IMS 3-shot)
16kCAMO-FSbox AP5.66FS-CDIS (iFS-RCNN+ITL 2-shot)
16kCAMO-FSbox AP5.08FS-CDIS (M-RCNN+ITL 1-shot)
16kCAMO-FSbox AP4.92FS-CDIS (M-RCNN+IMS 1-shot)
16kCAMO-FSbox AP4.71FS-CDIS (iFS-RCNN+ITL 1-shot)
16kCAMO-FSbox AP4.5FS-CDIS (MTFA+IMS 1-shot)
16kCAMO-FSbox AP4.04FS-CDIS (Res101-MTFA+ITL 1-shot)
16kCAMO-FSbox AP2.74FS-CDIS (iFS-RCNN+IMS 1-shot)

Related Papers

GLAD: Generalizable Tuning for Vision-Language Models2025-07-17A Real-Time System for Egocentric Hand-Object Interaction Detection in Industrial Domains2025-07-17RS-TinyNet: Stage-wise Feature Fusion Network for Detecting Tiny Objects in Remote Sensing Images2025-07-17Decoupled PROB: Decoupled Query Initialization Tasks and Objectness-Class Learning for Open World Object Detection2025-07-17Dual LiDAR-Based Traffic Movement Count Estimation at a Signalized Intersection: Deployment, Data Collection, and Preliminary Analysis2025-07-17Vision-based Perception for Autonomous Vehicles in Obstacle Avoidance Scenarios2025-07-16Tomato Multi-Angle Multi-Pose Dataset for Fine-Grained Phenotyping2025-07-15Doodle Your Keypoints: Sketch-Based Few-Shot Keypoint Detection2025-07-10