TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

SotA/Time Series/Action Recognition

Action Recognition

307 benchmarks2759 papers

Action Recognition is a computer vision task that involves recognizing human actions in videos or images. The goal is to classify and categorize the actions being performed in the video or image into a predefined set of action classes.

In the video domain, it is an open question whether training an action classification network on a sufficiently large dataset, will give a similar boost in performance when applied to a different temporal task or dataset. The challenges of building video datasets has meant that most popular benchmarks for action recognition are small, having on the order of 10k videos.

Please note some benchmarks may be located in the Action Classification or Video Classification tasks, e.g. Kinetics-400.

Benchmarks

Action Recognition on NTU RGB+D

Accuracy (CS)Accuracy (CV)Ensembled ModalitiesAccuracy (12 unseen classes)Accuracy (5 unseen classes)Random Split AccuracyGFLOPs per predCross Subject AccuracyCross View AccuracyHarmonic Mean (5 unseen classes)Harmonic Mean (12 unseen classes)Random Split Harmonic Mean

Action Recognition on UCF101

3-fold Accuracy1:1 AccuracyAccuracyAccuracy 20%Testsplit-1 Top-1 AccuracyPre-Training DatasetFrozen

Action Recognition on Something-Something V2

Top-1 AccuracyTop-5 AccuracyParametersGFLOPs

Action Recognition on HMDB-51

Average accuracy of 3 splits

Action Recognition on Something-Something V1

Top 1 AccuracyTop 5 AccuracyParam.GFLOPs

Action Recognition on NTU RGB+D 120

Accuracy (Cross-Subject)Accuracy (Cross-Setup)Ensembled ModalitiesGFLOPS per predictionAccuracy (10 unseen classes)Accuracy (24 unseen classes)xsub (%)xset (%)Random Split AccuracyHarmonic Mean (10 unseen classes)Harmonic Mean (24 unseen classes)Random Split Harmonic MeanEncoderClassifier

Action Recognition on HMDB51

Top-1 Accuracy1:1 AccuracyAccuracyAverage accuracy of 3 splitsPre-Training DatasetFrozen

Action Recognition on Kinetics-Skeleton dataset

AccuracyGFLOPS per prediction

Action Recognition on AVA v2.2

mAPmAP (Val)

Action Recognition on EPIC-KITCHENS-100

Action@1Verb@1Noun@1Recall@5Top-5 VerbTop-5 NounHMGFLOPs

Action Recognition on CholecT50 (Challenge)

mAP

Action Recognition on N-UCLA

AccuracyAccuracy (Cross-Subject)Accuracy (Cross-View)Data Modality (Joint, Bone, Motion)

Action Recognition on Diving-48

Accuracy

Action Recognition on AVA v2.1

mAP (Val)GFlopsParams (M)

Action Recognition on ActivityNet

mAP

Action Recognition on HMDB51 (finetuned)

Top-1 AccuracyPretraining Dataset

Action Recognition on UCF101 (finetuned)

3-fold AccuracyPretrain

Action Recognition on Jester (Gesture Recognition)

Val

Action Recognition on THUMOS’14

mAP@0.5mAP@0.4mAP@0.3mAP@0.1mAP@0.2

Action Recognition on H2O (2 Hands and Objects)

Actions Top-1AccuracyRGBHand PoseObject PoseObject Label

Action Recognition on Sports-1M

Video hit@5Video hit@1 Clip Hit@1Video hit@1

Action Recognition on J-HMDB

Accuracy (RGB+pose)Accuracy (pose)

Action Recognition on Casia V1+

AUCBalanced Accuracy

Action Recognition on DSO-1

AUCBalanced Accuracy

Action Recognition on UAV-Human

CSv1(%)CSv2(%)Top 1 Accuracy

Action Recognition on CATER

Average-mAP

Action Recognition on COVERAGE

Balanced AccuracyAUC

Action Recognition on CocoGlide

Balanced AccuracyAUC

Action Recognition on Columbia

AUCBalanced Accuracy

Action Recognition on EPIC-KITCHENS-100 (test)

recall@5

Action Recognition on HACS

Top 1 AccuracyTop 5 Accuracy

Action Recognition on Kinetics-100

Accuracy

Action Recognition on Assembly101

Actions Top-1Verbs Top-1Object Top-1Verbs Recall@5Objects Recall@5Actions Recall@5HM

Action Recognition on EPIC-KITCHENS-55 (Seen test set (S1))

Top 1 Accuracy - Act.Top 1 Accuracy - NounTop 1 Accuracy - VerbTop 5 Accuracy - Act.Top 5 Accuracy - NounTop 5 Accuracy - Verb

Action Recognition on EPIC-KITCHENS-55 (Unseen test set (S2)

Top 1 Accuracy - Act.Top 1 Accuracy - NounTop 1 Accuracy - VerbTop 5 Accuracy - Act.Top 5 Accuracy - NounTop 5 Accuracy - Verb

Action Recognition on PKU-MMD

Random Split AccuracyX-SubX-ViewmAP@0.50 (CV)mAP@0.50 (CS)Accuracy (Cross-Subject)Random Split Harmonic Mean

Action Recognition on SHREC 2017 track on 3D Hand Gesture Recognition

28 gestures accuracy14 gestures accuracySpeed (FPS)No. Parameters

Action Recognition on Charades-Ego

mAP

Action Recognition on CholecT50

Mean AP

Action Recognition on JHMDB (2D poses only)

Average accuracy of 3 splitsAccuracyNo. parameters

Action Recognition on Kinetics-600

Top-1 AccuracyTop-5 Accuracy

Action Recognition on Something-Something-100

1:1 Accuracy

Action Recognition on Animal Kingdom

mAP

Action Recognition on BAR

Accuracy

Action Recognition on CASIA (OSN-transmitted - Facebook)

AUCF-scoreIntersection over Union

Action Recognition on CASIA (OSN-transmitted - Wechat)

AUCIntersection over Unionf-Score

Action Recognition on CASIA (OSN-transmitted - Weibo)

AUCIntersection over Unionf-Score

Action Recognition on CASIA (OSN-transmitted - Whatsapp)

AUCIntersection over Unionf-Score

Action Recognition on Columbia (OSN-transmitted - Facebook)

AUCf-ScoreIntersection over Union

Action Recognition on Columbia (OSN-transmitted - Wechat)

AUCf-ScoreIntersection over Union

Action Recognition on Columbia (OSN-transmitted - Weibo)

AUCf-ScoreIntersection over Union

Action Recognition on Columbia (OSN-transmitted - Whatsapp)

AUCf-ScoreIntersection over Union

Action Recognition on DSO (OSN-transmitted - Facebook)

AUCf-ScoreIntersection over Union

Action Recognition on DSO (OSN-transmitted - Wechat)

AUCf-ScoreIntersection over Union

Action Recognition on DSO (OSN-transmitted - Weibo)

AUCf-ScoreIntersection over Union

Action Recognition on DSO (OSN-transmitted - Whatsapp)

AUCf-ScoreIntersection over Union

Action Recognition on First-Person Hand Action Benchmark

1:1 Accuracy1:3 Accuracy3:1 AccuracyCross-person Accuracy

Action Recognition on HAA500

Top-1 (%)

Action Recognition on Kinetics-400

Top-1 accuracy %Top-1 AccuracyTop-5 AccuracyActions Top-1 (S1)Top-5 Accuracy %

Action Recognition on LoTE-Animal

Accuracy (Top-1)

Action Recognition on MOMA-LRG

Activity Classification Accuracy (5-shot 5-way)Subactivity Classification Accuracy (5-shot 5-way)

Action Recognition on NIST (OSN-transmitted - Facebook)

AUCf-ScoreIntersection over Union

Action Recognition on NIST (OSN-transmitted - Wechat)

AUCf-ScoreIntersection over Union

Action Recognition on NIST (OSN-transmitted - Weibo)

AUCf-ScoreIntersection over Union

Action Recognition on NIST (OSN-transmitted - Whatsapp)

AUCf-ScoreIntersection over Union

Action Recognition on Volleyball

Accuracy

Action Recognition on EGTEA

Top-1 Accuracy

Action Recognition on Gaming 3D (G3D)

Accuracy

Action Recognition on JHMDB Pose Tracking

PCK@0.1PCK@0.2PCK@0.3PCK@0.4PCK@0.5

Action Recognition on NTU60-X

Accuracy (Body + Fingers joints)Accuracy (Body joints)Accuracy (Body + Fingers + Face joints)

Action Recognition on RareAct

mWAP

Action Recognition on UPenn Action

Accuracy

Action Recognition on Drive&Act

mean per-class accuracy

Action Recognition on EgoExoLearn

Accuracy

Action Recognition on FS-Something-Something V2-Full

Top-1 Accuracy(5-Way-1-Shot)Top-1 Accuracy(5-Way-5-Shot)

Action Recognition on FS-Something-Something V2-Small

Top-1 Accuracy(5-Way-1-Shot)Top-1 Accuracy(5-Way-5-Shot)

Action Recognition on Florence 3D

Accuracy

Action Recognition on J-HMBD Early Action

10%

Action Recognition on MA-52

F1_meanTop-1 Acc [Action]

Action Recognition on Mimetics

mAP

Action Recognition on Okutama-Action

Accuracy

Action Recognition on Penn Action

Accuracy

Action Recognition on SL-Animals

Accuracy (% )

Action Recognition on TCG-dataset

AccF1-ScoreJaccard Index

Action Recognition on UT-Kinect

Accuracy

Action Recognition on miniSports

AccuracyClip Hit@1Video hit@1Video hit@5

Action Recognition on zsRE

edit successlocalityportabilityfluency

Action Recognition on 100 sleep nights of 8 caregivers

10%

Action Recognition on 50-Salads

Top-1 Accuracy

Action Recognition on ActionNet-VE

F-measure (%)

Action Recognition on Charades

MAP

Action Recognition on CholecT40

mAP

Action Recognition on DVS128 Gesture

Accuracy (% )

Action Recognition on Drone-Action

Top 1 AccuracyTop-1 Accuracy

Action Recognition on EPIC-KITCHENS-55

Top-1 Accuracy

Action Recognition on EgoGesture

Top-1 AccuracyTop-5 Accuracy

Action Recognition on Hockey

Accuracy

Action Recognition on IndustReal

Top-1Top-5

Action Recognition on KTH

16:9 Accuracy

Action Recognition on MECCANO

Top-1 Accuracy

Action Recognition on NEC Drone

Top 1 Accuracy

Action Recognition on RoCoG-v2

Top-1 Accuracy

Action Recognition on SBU / SBU-Refine

Accuracy

Action Recognition on Skeleton-Mimetics

AccuracyAccuracy (%)

Action Recognition on THUMOS14

Accuracy

Action Recognition on UAV Human

Top 1 Accuracy

Action Recognition on UCF 101

3-fold Accuracy

Action Recognition on UCF-101

3-fold AccuracyAccuracy

Action Recognition on UCF-HMDB

AUROC

Action Recognition on UCF101-MiTv2

AUROC

Action Recognition on UCFSports

leave one out cross validation(LOOCV)

Action Recognition on UTD-MHAD

Accuracy

Action Recognition on VIRAT Ground 2.0

Average Accuracy

Action Recognition on CAD-120

Accuracy

Action Recognition on CholecT45

mAP

Action Recognition on CholecT45 (cross-val)

mAP

Action Recognition on CholecT50 (cross-val)

mAP

Action Recognition on CholecT50(cross-val)

mAP

Action Recognition on HDM05

Accuracy

Action Recognition on ICVL-4

Accuracy

Action Recognition on IRD

Accuracy

Action Recognition on MSR Action3D

Accuracy

Action Recognition on MSR ActionPairs

Accuracy

Action Recognition on MSRC-12

Accuracy

Action Recognition on MTL-AQA

Position AccuracyArmstand AccuracyRotation Type AccuracyNo. of Somersaults AccuracyNo. of Twists Accuracy

Action Recognition on Real Life Violence Situations Dataset

accuracy

Action Recognition on SYSU 3D

Accuracy

Action Recognition on Skeletics-152

Accuracy (Cross-Subject)

Action Recognition on UWA3D

Accuracy

Action Recognition on Varying-view RGB-D Action-Skeleton

Accuracy (CS)Accuracy (CV I)Accuracy (CV II)Accuracy (AV I)Accuracy (AV II)

Action Recognition on Win-Fail Action Understanding

2-Class Accuracy