Action Recognition on NTU RGB+D

Metric: Accuracy (CV) (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

#	Model↕	Accuracy (CV)▼	Extra Data	Paper	Date↕	Code
1	PoseC3D (RGB + Pose)	99.6	No	Revisiting Skeleton-based Action Recognition	2021-04-28	Code
2	DSCNet (RGB + Pose)	99.4	No	-	-	Code
3	π-ViT (RGB + Pose)	99	Yes	Just Add $π$! Pose Induced Video Transformers fo...	2023-11-30	Code
4	EPAM-Net	99	No	EPAM-Net: An Efficient Pose-driven Attention-gui...	2024-08-10	Code
5	ViewCon (RGB + Pose)	98.9	No	-	-	Code
6	MMNet (RGB + Pose)	98.8	Yes	-	-	Code
7	Hierarchical Action Classification (RGB + Pose)	98.79	No	Hierarchical Action Classification with Network ...	2020-07-30	-
8	ST-GCN [PYSKL, 2D Skeleton]	98.3	No	PYSKL: Towards Good Practices for Skeleton Actio...	2022-05-19	Code
9	DVANet (RGB only)	98.1	No	DVANet: Disentangling View and Action Features f...	2023-12-10	Code
10	UMDR (RGB-D)	98	No	A Unified Multimodal De- and Re-coupling Framewo...	2022-11-16	Code
11	VPN (RGB + Pose)	98	Yes	VPN: Learning Video-Pose Embedding for Activitie...	2020-07-06	Code
12	3DA (RGB + Pose)	97.9	No	Cross-Modal Learning with 3D Deformable Attentio...	2022-12-12	-
13	π-ViT (RGB only)	97.9	Yes	Just Add $π$! Pose Induced Video Transformers fo...	2023-11-30	Code
14	ProtoGCN	97.8	No	Revealing Key Details to See Differences: A Nove...	2024-11-28	Code
15	SkateFormer	97.8	No	SkateFormer: Skeletal-Temporal Transformer for H...	2024-03-14	Code
16	MSSTNet	97.8	No	-	-	Code
17	EPP-Net (Parsing + Pose)	97.7	No	Explore Human Parsing Modality for Action Recogn...	2024-01-04	Code
18	DG-STGCN	97.5	No	DG-STGCN: Dynamic Spatial-Temporal Modeling for ...	2022-10-12	Code
19	MAMP	97.5	No	Masked Motion Predictors are Strong 3D Action Re...	2023-08-14	Code
20	TSMF (RGB + Pose)	97.4	Yes	-	-	Code
21	MSA-GCN	97.4	No	-	-	-
22	DeGCN	97.4	No	-	-	Code
23	MMCL	97.4	Yes	Multi-Modality Co-Learning for Efficient Skeleto...	2024-07-22	Code
24	ST-GCN++ [PYSKL, 3D Skeleton]	97.4	No	PYSKL: Towards Good Practices for Skeleton Actio...	2022-05-19	Code
25	MaskCLR	97.3	No	-	-	-
26	STEP-CATFormer	97.3	Yes	STEP CATFormer: Spatial-Temporal Effective Body-...	2023-12-06	Code
27	STGAT	97.3	No	Spatial Temporal Graph Attention Network for Ske...	2022-08-18	Code
28	Action Machine (RGB only)	97.2	No	Action Machine: Rethinking Action Recognition in...	2018-12-14	-
29	JMDA (based on Skeleton MixFormer)	97.2	No	-	-	Code
30	LA-GCN	97.2	Yes	Language Knowledge-Assisted Representation Learn...	2023-05-21	Code
31	HD-GCN	97.2	No	Hierarchically Decomposed Graph Convolutional Ne...	2022-08-23	Code
32	MotionBert (finetune)	97.2	No	MotionBERT: A Unified Perspective on Learning Hu...	2022-10-12	Code
33	IPP-Net (Parsing + Pose)	97.1	No	Integrating Human Parsing and Pose Network for H...	2023-07-16	Code
34	PoseC3D [3D Heatmap]	97.1	Yes	Revisiting Skeleton-based Action Recognition	2021-04-28	Code
35	Shap-Mix	97.1	No	Shap-Mix: Shapley Value Guided Mixing for Long-T...	2024-07-17	Code
36	InfoGCN	97.1	No	-	-	Code
37	DSTSA-GCN	97.03	No	DSTSA-GCN: Advancing Skeleton-Based Gesture Reco...	2025-01-21	Code
38	DSTSA-GCN	97.03	No	DSTSA-GCN: Advancing Skeleton-Based Gesture Reco...	2025-01-21	Code
39	SkeletonGCL (based on CTR-GCN)	97	No	Graph Contrastive Learning for Skeleton-based Ac...	2023-01-26	Code
40	BlockGCN	97	No	-	-	Code
41	LST	97	Yes	Generative Action Description Prompts for Skelet...	2022-08-10	Code
42	TCA-GCN	97	No	Skeleton-based Action Recognition via Temporal-C...	2022-05-31	Code
43	JPFormer	96.9	No	-	-	Code
44	JPFormer	96.9	No	-	-	Code
45	Stream-GCN	96.9	No	Action Recognition with Multi-stream Motion Mode...	2023-06-13	-
46	TD-GCN	96.8	No	-	-	Code
47	CTR-GCN	96.8	No	Channel-wise Topology Refinement Graph Convoluti...	2021-07-26	Code
48	PSUMNet	96.7	No	PSUMNet: Unified Modality Part Streams are All Y...	2022-08-11	Code
49	Skeletal GNN	96.7	Yes	Learning Skeletal Graph Neural Networks for Hard...	2021-08-16	-
50	DualHead-Net	96.6	No	Learning Multi-Granular Spatio-Temporal Graph Ne...	2021-08-10	Code
51	STAR-Transformer (RGB + Pose)	96.5	No	STAR-Transformer: A Spatio-temporal Cross Attent...	2022-10-14	-
52	Hyperformer	96.5	No	Hypergraph Transformer for Skeleton-based Action...	2022-11-17	Code
53	MS-AAGCN+TEM	96.5	No	Temporal Extension Module for Skeleton-Based Act...	2020-03-19	-
54	4s Shift-GCN	96.5	Yes	-	-	Code
55	ST-GCN [PYSKL, 3D Skeleton]	96.5	No	Spatial Temporal Graph Convolutional Networks fo...	2018-01-23	Code
56	AngNet-JA + BA + JBA + VJBA	96.4	Yes	Fusing Higher-order Features in Graph Neural Net...	2021-05-04	Code
57	DSTA-Net	96.4	No	Decoupled Spatial-Temporal Attention Network for...	2020-07-07	Code
58	CGCN	96.4	No	Unifying Graph Embedding Features with Graph Con...	2020-03-06	-
59	Sym-GNN	96.4	No	Symbiotic Graph Neural Networks for 3D Skeleton-...	2019-10-05	-
60	BAGCN	96.3	No	Focusing and Diffusion: Bidirectional Attentive ...	2019-12-24	-
61	FGCN-spatial+FGCN-motion	96.3	No	Feedback Graph Convolutional Network for Skeleto...	2020-03-17	-
62	Action Capsules	96.3	No	Action Capsules: Human Skeleton Action Recognition	2023-01-30	-
63	MS-G3D Net	96.2	Yes	Disentangling and Unifying Graph Convolutions fo...	2020-03-31	Code
64	MS-AAGCN	96.2	No	Skeleton-Based Action Recognition with Multi-Str...	2019-12-15	Code
65	EfficientGCN-B4	96.1	No	Constructing Stronger and Faster Baselines for S...	2021-06-29	Code
66	DGNN	96.1	No	-	-	Code
67	ST-TR-agcn	96.1	No	Skeleton-based Action Recognition via Spatial an...	2020-08-17	Code
68	Dynamic GCN	96	No	Dynamic GCN: Context-enriched Topology Learning ...	2020-07-29	Code
69	PA-ResGCN-B19	96	No	Stronger, Faster and More Explainable: A Graph C...	2020-10-20	Code
70	Mix-Dimension	96	No	Mix Dimension in Poincaré Geometry for 3D Skelet...	2020-07-30	-
71	JB-AAGCN	96	No	Skeleton-Based Action Recognition with Multi-Str...	2019-12-15	Code
72	2s-SDGCN	95.74	No	-	-	-
73	GCN-NAS	95.7	No	Learning Graph Convolutional Network for Skeleto...	2019-11-11	Code
74	EfficientGCN-B2	95.5	No	Constructing Stronger and Faster Baselines for S...	2021-06-29	Code
75	AutoGCN	95.5	No	AutoGCN -- Towards Generic Human Activity Recogn...	2024-02-02	Code
76	PoseMap (RGB+Pose)	95.2	No	-	-	-
77	3s-HYSP	95.2	No	HYperbolic Self-Paced Learning for Self-Supervis...	2023-03-10	Code
78	ST-GCN [Vanilla, 2D Skeleton]	95.1	No	Spatial Temporal Graph Convolutional Networks fo...	2018-01-23	Code
79	2s-NLGCN	95.1	No	Two-Stream Adaptive Graph Convolutional Networks...	2018-05-20	Code
80	VA-fusion (aug.)	95	No	View Adaptive Neural Networks for High Performan...	2018-04-20	Code
81	AGC-LSTM (Joint&Part)	95	No	An Attention Enhanced Graph Convolutional LSTM N...	2019-02-25	-
82	CoST-GCN* (2-stream)	95	No	Continual Spatio-Temporal Graph Convolutional Ne...	2022-03-21	Code
83	FUSION (IR+Pose)	94.9	No	Infrared and 3D skeleton feature fusion for RGB-...	2020-02-28	Code
84	TD-GDSCN	94.9	No	-	-	Code
85	SLnL-rFA	94.9	No	Skeleton-Based Action Recognition with Synchrono...	2018-11-10	-
86	CoS-TR* (2-stream)	94.8	No	Continual Spatio-Temporal Graph Convolutional Ne...	2022-03-21	Code
87	SCK⊕	94.75	Yes	Tensor Representations for Action Recognition	2020-12-28	Code
88	EfficientGCN-B0	94.7	No	Constructing Stronger and Faster Baselines for S...	2021-06-29	Code
89	SGN	94.5	No	Semantics-Guided Neural Networks for Efficient S...	2019-04-02	Code
90	GR-GCN	94.3	No	Optimized Skeleton-based Action Recognition via ...	2018-11-29	-
91	AS-GCN	94.2	No	Actional-Structural Graph Convolutional Networks...	2019-04-26	Code
92	Sem-GCN	94.2	No	-	-	-
93	Dense IndRNN	93.97	No	Deep Independently Recurrent Neural Network (Ind...	2019-10-11	Code
94	CoST-GCN*	93.8	No	Continual Spatio-Temporal Graph Convolutional Ne...	2022-03-21	Code
95	3SCNN	93.7	No	-	-	-
96	PGCN-TCA	93.6	No	-	-	-
97	3s RA-GCN	93.6	No	Richly Activated Graph Convolutional Network for...	2020-08-09	Code
98	HYSP	93.5	No	HYperbolic Self-Paced Learning for Self-Supervis...	2023-03-10	Code
99	3s RA-GCN	93.5	No	Richly Activated Graph Convolutional Network for...	2019-05-16	Code
100	ST-GCN	93.4	No	Continual Spatio-Temporal Graph Convolutional Ne...	2022-03-21	Code
101	PeGCN	93.4	No	Predictively Encoded Graph Convolutional Network...	2020-03-17	Code
102	MANs (DenseNet-161)	93.22	No	Memory Attention Networks for Skeleton-based Act...	2018-04-23	Code
103	PB-GCN (Skeleton only)	93.2	No	Part-based Graph Convolutional Network for Actio...	2018-09-13	Code
104	Glimpse Clouds (RGB only)	93.2	No	Glimpse Clouds: Human Activity Recognition from ...	2018-02-22	Code
105	PB-GCN	93.2	No	Part-based Graph Convolutional Network for Actio...	2018-09-13	Code
106	3s-USDRL (DSTE) This work	93.2	No	USDRL: Unified Skeleton-Based Dense Representati...	2024-12-12	Code
107	ST-GCN [Vanilla, 3D Skeleton]	93.2	No	Spatial Temporal Graph Convolutional Networks fo...	2018-01-23	Code
108	AR-GCN	93.2	No	-	-	-
109	CoAGCN* (2-stream)	93.1	No	Continual Spatio-Temporal Graph Convolutional Ne...	2022-03-21	Code
110	2s RA-GCN	93	No	Richly Activated Graph Convolutional Network for...	2019-05-16	Code
111	GVFE + AS-GCN with DH-TCN	92.8	No	Vertex Feature Encoding and Hierarchical Tempora...	2019-12-20	-
112	TS-SAN	92.7	No	Self-Attention Network for Skeleton-based Human ...	2019-12-18	-
113	CoAGCN*	92.6	No	Continual Spatio-Temporal Graph Convolutional Ne...	2022-03-21	Code
114	CoS-TR*	92.4	No	Continual Spatio-Temporal Graph Convolutional Ne...	2022-03-21	Code
115	SR-TSL	92.4	No	Skeleton-Based Action Recognition with Spatial R...	2018-05-07	-
116	PR-GCN	91.7	No	Pose Refinement Graph Convolutional Network for ...	2020-10-14	-
117	RF-Action	91.6	No	Making the Invisible Visible: Action Recognition...	2019-09-20	-
118	HCN	91.1	No	Co-occurrence Feature Learning from Skeleton Dat...	2018-04-17	Code
119	FO-GASTM	90.05	No	-	-	-
120	DM-3DCNN	89.5	No	-	-	Code
121	CNN+Motion+Trans	89.3	No	Skeleton-based Action Recognition with Convoluti...	2017-04-25	Code
122	RGB+Skeleton (cross-attention)	89.27	No	-	-	-
123	IndRNN (with jpd)	89	No	A Comparative Review of Recent Kinect-based Acti...	2019-06-24	Code
124	Bayesian GC-LSTM	89	No	-	-	-
125	ST-GCN-jpd	88.84	No	A Comparative Review of Recent Kinect-based Acti...	2019-06-24	Code
126	3s-ActCLR	88.8	No	Actionlet-Dependent Contrastive Learning for Uns...	2023-03-20	-
127	ARRN-LSTM	88.8	No	Relational Network for Skeleton-Based Action Rec...	2018-05-07	-
128	EleAtt-GRU (aug.)	88.4	No	EleAtt-RNN: Adding Attentiveness to Neurons in R...	2019-09-03	-
129	ST-GCN	88.3	No	Spatial Temporal Graph Convolutional Networks fo...	2018-01-23	Code
130	Ind-RNN	88	No	Independently Recurrent Neural Network (IndRNN):...	2018-03-13	Code
131	VA-LSTM	87.6	No	View Adaptive Recurrent Neural Networks for High...	2017-03-24	Code
132	Skeleton Visualization	87.2	No	-	-	-
133	EleAtt-GRU	87.1	No	Adding Attentiveness to the Neurons in Recurrent...	2018-07-12	-
134	HPM_RGB+HPM_3D+Traj	86.1	No	Learning Human Pose Models from Synthesized Data...	2017-07-04	-
135	Clips+CNN+MTLN	84.8	No	A New Representation of Skeleton Sequences for 3...	2017-03-09	-
136	Skelemotion + Yang et al. (Skeleton only)	84.7	No	SkeleMotion: A New Representation of Skeleton Jo...	2019-07-30	Code
137	Skelemotion + Yang et al.	84.7	No	SkeleMotion: A New Representation of Skeleton Jo...	2019-07-30	Code
138	F2CSkeleton	84.6	No	A Fine-to-Coarse Convolutional Neural Network fo...	2018-05-30	-
139	GCA-LSTM	84	No	-	-	-
140	URNN-2L-T	83.2	No	-	-	-
141	TCN	83.1	No	Temporal Convolutional Networks: A Unified Appro...	2016-08-29	Code
142	Five Spatial Skeleton Features	82.31	No	Investigation of Different Skeleton Features for...	2017-05-02	Code
143	Ensemble TS-LSTM v2	81.25	No	-	-	Code
144	SkeletonNet	81.2	No	-	-	-
145	STA-LSTM	81.2	No	An End-to-End Spatio-Temporal Attention Model fo...	2016-11-18	-
146	TSRJI (Late Fusion) + HCN	80.3	No	Skeleton Image Representation for 3D Action Reco...	2019-09-11	Code
147	Two-Stream RNN	79.5	No	Modeling Temporal Dynamics and Spatial Configura...	2017-04-09	-
148	Spatio-Temporal LSTM	77.7	No	Spatio-Temporal LSTM with Trust Gates for 3D Hum...	2016-07-24	-
149	ST-LSTM	75.5	No	Spatio-Temporal LSTM with Trust Gates for 3D Hum...	2016-07-24	-
150	Part-aware LSTM	70.27	No	NTU RGB+D: A Large Scale Dataset for 3D Human Ac...	2016-04-11	Code
151	Deep LSTM	67.3	No	NTU RGB+D: A Large Scale Dataset for 3D Human Ac...	2016-04-11	Code
152	Dynamic Skeletons	65.2	No	-	-	-
153	H-RNN	64	No	-	-	-
154	Lie Group	52.8	No	-	-	Code
155	Skeleton Quads	41.4	No	-	-	-