Video on THUMOS’14

Metric: mAP IOU@0.5 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	mAP IOU@0.5▼	Extra Data	Paper	Date↕	Code
1	AdaTAD (VideoMAEv2-giant)	80.9	No	End-to-End Temporal Action Detection with 1B Par...	2023-11-28	Code
2	RDFA-S6 (InternVideo2-6B)	78.2	No	Enhancing Temporal Action Localization: Advanced...	2024-07-18	Code
3	ActionMamba(InternVideo2-6B)	76.9	No	Video Mamba Suite: State Space Model as a Versat...	2024-03-14	Code
4	TriDet (VideoMAE v2-g feature)	73.3	Yes	Temporal Action Localization with Enhanced Insta...	2023-09-11	Code
5	ActionFormer (VideoMAE V2-g features)	73	Yes	VideoMAE V2: Scaling Video Masked Autoencoders w...	2023-03-29	Code
6	TriDet (I3D features)	72.9	No	TriDet: Temporal Action Detection with Relative ...	2023-03-13	Code
7	TemporalMaxer (I3D features)	71.8	No	TemporalMaxer: Maximize Temporal Context with on...	2023-03-16	Code
8	ASL(I3D features)	71.7	No	Action Sensitivity Learning for Temporal Action ...	2023-05-25	-
9	ActionFormer (I3D features)	71	No	ActionFormer: Localizing Moments of Actions with...	2022-02-16	Code
10	DualDETR (I3D features)	70.4	No	Dual DETRs for Multi-Label Temporal Action Detec...	2024-03-31	-
11	BasicTAD (160,6,192,R50-SlowOnly)	63.5	No	BasicTAD: an Astounding RGB-Only Baseline for Te...	2022-05-05	Code
12	TadML(two-stream)	62.53	No	TadML: A fast temporal action detection with Mec...	2022-06-07	Code
13	TadTR	60.1	No	End-to-end Temporal Action Detection with Transf...	2021-06-18	Code
14	BasicTAD (112,3,96,R50-SlowOnly)	58.6	No	BasicTAD: an Astounding RGB-Only Baseline for Te...	2022-05-05	Code
15	ReAct (TSN features)	57.1	No	ReAct: Temporal Action Detection with Relational...	2022-07-14	Code
16	AVFusion	57.1	Yes	Hear Me Out: Fusional Approaches for Audio Augme...	2021-06-27	Code
17	TAGS (I3D)	57	No	Proposal-Free Temporal Action Detection via Glob...	2022-07-14	Code
18	MUSES	56.9	No	Multi-shot Temporal Event Localization: a Benchm...	2020-12-17	Code
19	TadML(rgb-only)	56.61	No	TadML: A fast temporal action detection with Mec...	2022-06-07	Code
20	E2E-TAD (SlowFast R50+TadTR)	56	No	An Empirical Study of End-to-End Temporal Action...	2022-04-06	Code
21	DCAN (TSN features)	54.1	No	DCAN: Improving Temporal Action Detection via Du...	2021-12-07	Code
22	DaoTAD	53.8	No	RGB Stream Is Enough for Temporal Action Detection	2021-07-09	Code
23	TSP	53.5	No	TSP: Temporally-Sensitive Pretraining of Video E...	2020-11-23	Code
24	VSGN	52.4	No	Video Self-Stitching Graph Network for Temporal ...	2020-11-30	Code
25	GCM	51.9	No	Graph Convolutional Module for Temporal Action L...	2021-12-01	-
26	AGT (Ours)	50.2	No	Activity Graph Transformer for Temporal Action L...	2021-01-21	-
27	P-GCN	49.1	No	Graph Convolutional Networks for Temporal Action...	2019-09-07	Code
28	Decouple-SSAD	44.2	No	Decoupling Localization and Classification in Si...	2019-04-16	Code
29	TAL-Net	42.8	No	Rethinking the Faster R-CNN Architecture for Tem...	2018-04-20	-
30	G-TAD	40.2	No	G-TAD: Sub-Graph Localization for Temporal Actio...	2019-11-26	Code
31	CO2-Net	38.3	No	Cross-modal Consensus Network for Weakly Supervi...	2021-07-27	Code
32	CO2-Net	38.3	No	Cross-modal Consensus Network for Weakly Supervi...	2021-07-27	Code
33	BSN UNet	36.9	No	BSN: Boundary Sensitive Network for Temporal Act...	2018-06-08	Code
34	ASM-Loc	36.6	No	ASM-Loc: Action-aware Segment Modeling for Weakl...	2022-03-29	Code
35	BMN	32.2	No	BMN: Boundary-Matching Network for Temporal Acti...	2019-07-23	Code
36	CBR-TS	31	No	Cascaded Boundary Regression for Temporal Action...	2017-05-02	-
37	A2CL-PT	30.1	No	Adversarial Background-Aware Loss for Weakly-sup...	2020-07-13	Code
38	DeepMetricLearner	29.6	No	Weakly Supervised Temporal Action Localization U...	2020-01-21	Code
39	R-C3D	28.9	No	R-C3D: Region Convolutional 3D Network for Tempo...	2017-03-22	Code
40	TURN-FL-16 + S-CNN	25.6	No	TURN TAP: Temporal Unit Regression Network for T...	2017-03-17	Code
41	CDC	23.3	No	CDC: Convolutional-De-Convolutional Networks for...	2017-03-04	Code
42	S-CNN	19	No	Temporal Action Localization in Untrimmed Videos...	2016-01-09	Code
43	Yeung et al.	17.1	No	End-to-end Learning of Action Detection from Fra...	2015-11-22	Code

#1AdaTAD (VideoMAEv2-giant)SOTA
80.9
mAP IOU@0.5· 2023-11-28
End-to-End Temporal Action Detection with 1B Parameters Across 1000 Frames Code
#2RDFA-S6 (InternVideo2-6B)
78.2
mAP IOU@0.5· 2024-07-18
Enhancing Temporal Action Localization: Advanced S6 Modeling with Recurrent Mechanism Code
#3ActionMamba(InternVideo2-6B)
76.9
mAP IOU@0.5· 2024-03-14
Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding Code
#4TriDet (VideoMAE v2-g feature)SOTA
73.3
mAP IOU@0.5· Extra Data· 2023-09-11
Temporal Action Localization with Enhanced Instant Discriminability Code
#5ActionFormer (VideoMAE V2-g features)SOTA
73
mAP IOU@0.5· Extra Data· 2023-03-29
VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking Code
#6TriDet (I3D features)SOTA
72.9
mAP IOU@0.5· 2023-03-13
TriDet: Temporal Action Detection with Relative Boundary Modeling Code
#7TemporalMaxer (I3D features)
71.8
mAP IOU@0.5· 2023-03-16
TemporalMaxer: Maximize Temporal Context with only Max Pooling for Temporal Action Localization Code
#8ASL(I3D features)
71.7
mAP IOU@0.5· 2023-05-25
Action Sensitivity Learning for Temporal Action Localization
#9ActionFormer (I3D features)SOTA
71
mAP IOU@0.5· 2022-02-16
ActionFormer: Localizing Moments of Actions with Transformers Code
#10DualDETR (I3D features)
70.4
mAP IOU@0.5· 2024-03-31
Dual DETRs for Multi-Label Temporal Action Detection
#11BasicTAD (160,6,192,R50-SlowOnly)
63.5
mAP IOU@0.5· 2022-05-05
BasicTAD: an Astounding RGB-Only Baseline for Temporal Action Detection Code
#12TadML(two-stream)
62.53
mAP IOU@0.5· 2022-06-07
TadML: A fast temporal action detection with Mechanics-MLP Code
#13TadTRSOTA
60.1
mAP IOU@0.5· 2021-06-18
End-to-end Temporal Action Detection with Transformer Code
#14BasicTAD (112,3,96,R50-SlowOnly)
58.6
mAP IOU@0.5· 2022-05-05
BasicTAD: an Astounding RGB-Only Baseline for Temporal Action Detection Code
#15ReAct (TSN features)
57.1
mAP IOU@0.5· 2022-07-14
ReAct: Temporal Action Detection with Relational Queries Code
#16AVFusion
57.1
mAP IOU@0.5· Extra Data· 2021-06-27
Hear Me Out: Fusional Approaches for Audio Augmented Temporal Action Localization Code
#17TAGS (I3D)
57
mAP IOU@0.5· 2022-07-14
Proposal-Free Temporal Action Detection via Global Segmentation Mask Learning Code
#18MUSESSOTA
56.9
mAP IOU@0.5· 2020-12-17
Multi-shot Temporal Event Localization: a Benchmark Code
#19TadML(rgb-only)
56.61
mAP IOU@0.5· 2022-06-07
TadML: A fast temporal action detection with Mechanics-MLP Code
#20E2E-TAD (SlowFast R50+TadTR)
56
mAP IOU@0.5· 2022-04-06
An Empirical Study of End-to-End Temporal Action Detection Code
#21DCAN (TSN features)
54.1
mAP IOU@0.5· 2021-12-07
DCAN: Improving Temporal Action Detection via Dual Context Aggregation Code
#22DaoTAD
53.8
mAP IOU@0.5· 2021-07-09
RGB Stream Is Enough for Temporal Action Detection Code
#23TSPSOTA
53.5
mAP IOU@0.5· 2020-11-23
TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks Code
#24VSGN
52.4
mAP IOU@0.5· 2020-11-30
Video Self-Stitching Graph Network for Temporal Action Localization Code
#25GCM
51.9
mAP IOU@0.5· 2021-12-01
Graph Convolutional Module for Temporal Action Localization in Videos
#26AGT (Ours)
50.2
mAP IOU@0.5· 2021-01-21
Activity Graph Transformer for Temporal Action Localization
#27P-GCNSOTA
49.1
mAP IOU@0.5· 2019-09-07
Graph Convolutional Networks for Temporal Action Localization Code
#28Decouple-SSADSOTA
44.2
mAP IOU@0.5· 2019-04-16
Decoupling Localization and Classification in Single Shot Temporal Action Detection Code
#29TAL-NetSOTA
42.8
mAP IOU@0.5· 2018-04-20
Rethinking the Faster R-CNN Architecture for Temporal Action Localization
#30G-TAD
40.2
mAP IOU@0.5· 2019-11-26
G-TAD: Sub-Graph Localization for Temporal Action Detection Code
#31CO2-Net
38.3
mAP IOU@0.5· 2021-07-27
Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization Code
#32CO2-Net
38.3
mAP IOU@0.5· 2021-07-27
Cross-modal Consensus Network for Weakly Supervised Temporal Action Localization Code
#33BSN UNet
36.9
mAP IOU@0.5· 2018-06-08
BSN: Boundary Sensitive Network for Temporal Action Proposal Generation Code
#34ASM-Loc
36.6
mAP IOU@0.5· 2022-03-29
ASM-Loc: Action-aware Segment Modeling for Weakly-Supervised Temporal Action Localization Code
#35BMN
32.2
mAP IOU@0.5· 2019-07-23
BMN: Boundary-Matching Network for Temporal Action Proposal Generation Code
#36CBR-TSSOTA
31
mAP IOU@0.5· 2017-05-02
Cascaded Boundary Regression for Temporal Action Detection
#37A2CL-PT
30.1
mAP IOU@0.5· 2020-07-13
Adversarial Background-Aware Loss for Weakly-supervised Temporal Activity Localization Code
#38DeepMetricLearner
29.6
mAP IOU@0.5· 2020-01-21
Weakly Supervised Temporal Action Localization Using Deep Metric Learning Code
#39R-C3DSOTA
28.9
mAP IOU@0.5· 2017-03-22
R-C3D: Region Convolutional 3D Network for Temporal Activity Detection Code
#40TURN-FL-16 + S-CNNSOTA
25.6
mAP IOU@0.5· 2017-03-17
TURN TAP: Temporal Unit Regression Network for Temporal Action Proposals Code
#41CDCSOTA
23.3
mAP IOU@0.5· 2017-03-04
CDC: Convolutional-De-Convolutional Networks for Precise Temporal Action Localization in Untrimmed Videos Code
#42S-CNNSOTA
19
mAP IOU@0.5· 2016-01-09
Temporal Action Localization in Untrimmed Videos via Multi-stage CNNs Code
#43Yeung et al.SOTA
17.1
mAP IOU@0.5· 2015-11-22
End-to-end Learning of Action Detection from Frame Glimpses in Videos Code