TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Methodology/Zero-Shot Learning

Zero-Shot Learning

344 benchmarks1864 papers

Zero-shot learning (ZSL) is a model's ability to detect classes never seen during training. The condition is that the classes are not known during supervised learning.

Earlier work in zero-shot learning use attributes in a two-step approach to infer unknown classes. In the computer vision context, more recent advances learn mappings from image feature space to semantic space. Other approaches learn non-linear multimodal embeddings. In the modern NLP context, language models can be evaluated on downstream tasks without fine tuning.

Benchmark datasets for zero-shot learning include aPY, AwA, and CUB, among others.

( Image credit: Prototypical Networks for Few shot Learning in PyTorch )

Further readings:

  • Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Ugly
  • Zero-Shot Learning in Modern NLP
  • Zero-Shot Learning for Text Classification

Benchmarks

Zero-Shot Learning on NTU RGB+D

Accuracy (CS)Accuracy (CV)Ensembled ModalitiesAccuracy (12 unseen classes)Accuracy (5 unseen classes)Random Split AccuracyGFLOPs per predCross Subject AccuracyCross View AccuracyHarmonic Mean (5 unseen classes)Harmonic Mean (12 unseen classes)Random Split Harmonic Mean

Zero-Shot Learning on NTU RGB+D 120

Accuracy (Cross-Subject)Accuracy (Cross-Setup)Ensembled ModalitiesGFLOPS per predictionAccuracy (10 unseen classes)Accuracy (24 unseen classes)Random Split AccuracyHarmonic Mean (10 unseen classes)Harmonic Mean (24 unseen classes)Random Split Harmonic Mean

Zero-Shot Learning on THUMOS’14

mAP IOU@0.5mAP IOU@0.3mAP IOU@0.4mAP IOU@0.7mAP IOU@0.6Avg mAP (0.3:0.7)mAP IOU@0.1mAP IOU@0.2mAP@0.5mAP@AVG(0.1:0.9)mAP IOU@0.8mAP IOU@0.9avg-mAP (0.1-0.5)

Zero-Shot Learning on Kinetics-Skeleton dataset

AccuracyGFLOPS per prediction

Zero-Shot Learning on ActivityNet-1.3

mAPmAP IOU@0.5mAP IOU@0.75mAP IOU@0.95mAP@0.5mAP@0.5:0.95AR@100AUC (val)AUC (test)

Zero-Shot Learning on THUMOS 2014

mAP@0.5mAP@0.1:0.7mAP@0.1:0.5

Zero-Shot Learning on ActivityNet-1.2

mAP@0.5Mean mAPmAP IOU@0.5mAP IOU@0.1mAP IOU@0.3mAP IOU@0.7

Zero-Shot Learning on N-UCLA

AccuracyData Modality (Joint, Bone, Motion)

Zero-Shot Learning on FineAction

mAPmAP IOU@0.5mAP IOU@0.75mAP IOU@0.95

Zero-Shot Learning on MedConceptsQA

Accuracy

Zero-Shot Learning on CUB-200-2011

average top-1 classification accuracyAccuracyHarmonic meanAccuracy SeenAccuracy UnseenH

Zero-Shot Learning on HACS

Average-mAPmAP@0.5mAP@0.75mAP@0.95

Zero-Shot Learning on THUMOS14

avg-mAP (0.3-0.7)avg-mAP (0.1:0.7)avg-mAP (0.1-0.5)Avg mAP (0.3:0.7)

Zero-Shot Learning on J-HMDB

Accuracy (RGB+pose)Accuracy (pose)

Zero-Shot Learning on NUS-WIDE

mAP

Zero-Shot Learning on Casia V1+

AUCBalanced Accuracy

Zero-Shot Learning on DSO-1

AUCBalanced Accuracy

Zero-Shot Learning on SUN Attribute

average top-1 classification accuracyHarmonic meanHAccuracy SeenAccuracy Unseen

Zero-Shot Learning on UAV-Human

CSv1(%)CSv2(%)

Zero-Shot Learning on COVERAGE

Balanced AccuracyAUC

Zero-Shot Learning on CocoGlide

Balanced AccuracyAUC

Zero-Shot Learning on Columbia

AUCBalanced Accuracy

Zero-Shot Learning on MultiTHUMOS

Average mAPmAP IOU@0.5mAP IOU@0.7mAP IOU@0.2mAP IOU@0.1mAP IOU@0.3mAP IOU@0.9mAP IOU@0.4mAP IOU@0.6mAP IOU@0.8

Zero-Shot Learning on Open Images V4

MAP

Zero-Shot Learning on ActivityNet-GZSL(main)

HMZSL

Zero-Shot Learning on Assembly101

Actions Top-1Verbs Top-1Object Top-1

Zero-Shot Learning on CrossTask

Recall

Zero-Shot Learning on PKU-MMD

Random Split AccuracymAP@0.50 (CV)mAP@0.50 (CS)Accuracy (Cross-Subject)Random Split Harmonic Mean

Zero-Shot Learning on SHREC 2017 track on 3D Hand Gesture Recognition

28 gestures accuracy14 gestures accuracySpeed (FPS)No. Parameters

Zero-Shot Learning on UCF-GZSL(main)

HMZSL

Zero-Shot Learning on VGGSound-GZSL(main)

HMZSL

Zero-Shot Learning on EPIC-KITCHENS-100

Avg mAP (0.1-0.5)mAP IOU@0.1mAP IOU@0.2mAP IOU@0.3mAP IOU@0.4mAP IOU@0.5

Zero-Shot Learning on GTEA

mAP@0.1:0.7mAP@0.5

Zero-Shot Learning on JHMDB (2D poses only)

Average accuracy of 3 splitsAccuracyNo. parameters

Zero-Shot Learning on BEOID

mAP@0.1:0.7mAP@0.5

Zero-Shot Learning on ActivityNet-GZSL (cls)

HMZSL

Zero-Shot Learning on AwA2

average top-1 classification accuracyHarmonic meanAccuracy SeenAccuracy UnseenH

Zero-Shot Learning on CASIA (OSN-transmitted - Facebook)

AUCF-scoreIntersection over Union

Zero-Shot Learning on CASIA (OSN-transmitted - Wechat)

AUCIntersection over Unionf-Score

Zero-Shot Learning on CASIA (OSN-transmitted - Weibo)

AUCIntersection over Unionf-Score

Zero-Shot Learning on CASIA (OSN-transmitted - Whatsapp)

AUCIntersection over Unionf-Score

Zero-Shot Learning on Columbia (OSN-transmitted - Facebook)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on Columbia (OSN-transmitted - Wechat)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on Columbia (OSN-transmitted - Weibo)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on Columbia (OSN-transmitted - Whatsapp)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on DSO (OSN-transmitted - Facebook)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on DSO (OSN-transmitted - Wechat)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on DSO (OSN-transmitted - Weibo)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on DSO (OSN-transmitted - Whatsapp)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on First-Person Hand Action Benchmark

1:1 Accuracy1:3 Accuracy3:1 AccuracyCross-person Accuracy

Zero-Shot Learning on NIST (OSN-transmitted - Facebook)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on NIST (OSN-transmitted - Wechat)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on NIST (OSN-transmitted - Weibo)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on NIST (OSN-transmitted - Whatsapp)

AUCf-ScoreIntersection over Union

Zero-Shot Learning on UCF-GZSL (cls)

HMZSL

Zero-Shot Learning on UCF101

Accuracy

Zero-Shot Learning on VGGSound-GZSL (cls)

HMZSL

Zero-Shot Learning on CIFAR-10

Accuracy

Zero-Shot Learning on Caltech-101

Accuracy

Zero-Shot Learning on DTD

Accuracy

Zero-Shot Learning on EuroSAT

Accuracy

Zero-Shot Learning on FGVC-Aircraft

Accuracy

Zero-Shot Learning on Flowers-102

Accuracy

Zero-Shot Learning on Food-101

Accuracy

Zero-Shot Learning on Gaming 3D (G3D)

Accuracy

Zero-Shot Learning on H2O (2 Hands and Objects)

Accuracy

Zero-Shot Learning on ImageNet

Top 1 Accuracy

Zero-Shot Learning on JHMDB Pose Tracking

PCK@0.1PCK@0.2PCK@0.3PCK@0.4PCK@0.5

Zero-Shot Learning on NTU60-X

Accuracy (Body + Fingers joints)Accuracy (Body joints)Accuracy (Body + Fingers + Face joints)

Zero-Shot Learning on Oxford-IIIT Pets

Accuracy

Zero-Shot Learning on SUN397

Accuracy

Zero-Shot Learning on Stanford Cars

Accuracy

Zero-Shot Learning on THUMOS' 14

AR@100AR@1000AR@200AR@50AR@500avg-mAP (0.1:0.7)

Zero-Shot Learning on UPenn Action

Accuracy

Zero-Shot Learning on CIFAR-100

AccuracyAccuarcy

Zero-Shot Learning on COCO-MLT

Average mAP

Zero-Shot Learning on Drive&Act

mean per-class accuracy

Zero-Shot Learning on Florence 3D

Accuracy

Zero-Shot Learning on J-HMBD Early Action

10%

Zero-Shot Learning on MIT-States, generalized split

H-MeanSeen accuracyTest AUC top 1Unseen accuracyTest AUC top 2Test AUC top 3Val AUC top 1Val AUC top 2Val AUC top 3

Zero-Shot Learning on MSSD

mean average accuracy

Zero-Shot Learning on MUSES

mAPmAP@0.3mAP@0.4mAP@0.5mAP@0.6mAP@0.7

Zero-Shot Learning on Oxford 102 Flower

average top-1 classification accuracyHarmonic mean

Zero-Shot Learning on TCG-dataset

AccF1-ScoreJaccard Index

Zero-Shot Learning on UT-Kinect

Accuracy

Zero-Shot Learning on VOC-MLT

Average mAP

Zero-Shot Learning on zsRE

edit successlocalityportabilityfluency

Zero-Shot Learning on 100 sleep nights of 8 caregivers

10%

Zero-Shot Learning on AID

Accuracy

Zero-Shot Learning on ActEV

mAP

Zero-Shot Learning on ActivityNet Captions

Average F1Average PrecisionAverage Recall

Zero-Shot Learning on BBN Pronoun Coreference and Entity Type Corpus

F1

Zero-Shot Learning on CUB-200 - 0-Shot Learning

Average Per-Class Accuracy

Zero-Shot Learning on Caltech-UCSD Birds 200 - 2011

H

Zero-Shot Learning on DogCentric

Accuracy

Zero-Shot Learning on Ego4D MQ test

Average mAPRecall@1x (tIoU=0.5)

Zero-Shot Learning on Ego4D MQ val

Average mAPRecall@1x (tIoU=0.5)

Zero-Shot Learning on GDSCv2

Pearson correlation coefficient (PCC)

Zero-Shot Learning on HMDB51

AccuracyAverage accuracy of 3 splits

Zero-Shot Learning on How2QA

Accuracy

Zero-Shot Learning on ImageNet-1k to MSCOCO

mAP

Zero-Shot Learning on ImageNet_CN

Accuracy

Zero-Shot Learning on Kinetics-400

Actions Top-1 (S1)

Zero-Shot Learning on LSMDC

Accuracy

Zero-Shot Learning on MEXaction2

mAP

Zero-Shot Learning on MIT-States

A-accAUCAttribute accuracyObject accuracySeen accuracyTop-1 accuracy %Top-2 accuracy %Top-3 accuracy %Unseen accuracybest HM

Zero-Shot Learning on MLRSNet

Accuracy

Zero-Shot Learning on MSRVTT-QA

Accuracy

Zero-Shot Learning on MSVD-QA

Accuracy

Zero-Shot Learning on OPTIMAL31

Accuracy

Zero-Shot Learning on OntoNotes

F1

Zero-Shot Learning on PASCAL Context

k=10 mIOU

Zero-Shot Learning on PatternNet

Accuracy

Zero-Shot Learning on RESISC45

Accuracy

Zero-Shot Learning on RSC11

Accuracy

Zero-Shot Learning on RSICB128

Accuracy

Zero-Shot Learning on RSICB256

Accuracy

Zero-Shot Learning on S3DIS

HmIoU

Zero-Shot Learning on SBU / SBU-Refine

Accuracy

Zero-Shot Learning on SNIPS

Accuracy

Zero-Shot Learning on ScanNet

HmIoU

Zero-Shot Learning on SemanticKITTI

HmIoU

Zero-Shot Learning on THUMOS'14

mAP IOU@0.5

Zero-Shot Learning on TVQA

Accuracy

Zero-Shot Learning on UCF101-24

mAP@0.2

Zero-Shot Learning on UT Zappos50K

AUCAttribute accuracyObject accuracySeen accuracyUnseen accuracybest HM

Zero-Shot Learning on UT-Zappos

Top-1 accuracy %Top-2 accuracy %Top-3 accuracy %

Zero-Shot Learning on WHURS19

Accuracy

Zero-Shot Learning on aPY

H

Zero-Shot Learning on aPY - 0-Shot

Top-1Harmonic mean

Zero-Shot Learning on iVQA

Accuracy

Zero-Shot Learning on CAD-120

Accuracy

Zero-Shot Learning on HDM05

Accuracy

Zero-Shot Learning on MSR Action3D

Accuracy

Zero-Shot Learning on MSR ActionPairs

Accuracy

Zero-Shot Learning on MSRC-12

Accuracy

Zero-Shot Learning on SYSU 3D

Accuracy

Zero-Shot Learning on Skeletics-152

Accuracy (Cross-Subject)

Zero-Shot Learning on Skeleton-Mimetics

Accuracy (%)

Zero-Shot Learning on UWA3D

Accuracy

Zero-Shot Learning on Varying-view RGB-D Action-Skeleton

Accuracy (CS)Accuracy (CV I)Accuracy (CV II)Accuracy (AV I)Accuracy (AV II)