Moment Retrieval on QVHighlights

Metric: mAP (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	mAP▼	Extra Data	Paper	Date↕	Code
1	SG-DETR (w/ PT)	58.8	Yes	Saliency-Guided DETR for Moment Retrieval and Hi...	2024-10-02	Code
2	SG-DETR	54.1	No	Saliency-Guided DETR for Moment Retrieval and Hi...	2024-10-02	Code
3	LLaVA-MR	52.73	No	LLaVA-MR: Large Language-and-Vision Assistant fo...	2024-11-21	Code
4	FlashVTG	52	No	FlashVTG: Feature Layering and Adaptive Score Ha...	2024-12-18	Code
5	InternVideo2-6B	49.24	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
6	SG-DETR (ZS)	48.3	Yes	Saliency-Guided DETR for Moment Retrieval and Hi...	2024-10-02	Code
7	CG-DETR (w/ PT)	47.97	Yes	Correlation-Guided Query-Dependency Calibration ...	2023-11-15	Code
8	VideoLights-B-pt	47.94	Yes	VideoLights: Feature Refinement and Cross-Task A...	2024-12-02	Code
9	LA-DETR	47.93	No	Length-Aware DETR for Robust Moment Retrieval	2024-12-30	Code
10	BAM-DETR (w/ audio)	46.91	No	BAM-DETR: Boundary-Aligned Moment Detection Tran...	2023-11-30	Code
11	BAM-DETR (w/ PT ASR Captions)	46.67	Yes	BAM-DETR: Boundary-Aligned Moment Detection Tran...	2023-11-30	Code
12	LD-DETR	46.41	No	LD-DETR: Loop Decoder DEtection TRansformer for ...	2025-01-18	Code
13	R^2-Tuning	46.17	No	$R^2$-Tuning: Efficient Image-to-Video Transfer ...	2024-03-31	Code
14	BAM-DETR	45.36	No	BAM-DETR: Boundary-Aligned Moment Detection Tran...	2023-11-30	Code
15	video-mamba-suite	45.18	No	Video Mamba Suite: State Space Model as a Versat...	2024-03-14	Code
16	LLMEPET	44.05	No	Prior Knowledge Integration via LLM Encoding and...	2024-07-21	Code
17	UVCOM (w/ PT ASR Captions)	43.8	Yes	Bridging the Gap: A Unified Video Comprehension ...	2023-11-28	Code
18	UniVTG (w/ PT)	43.63	Yes	UniVTG: Towards Unified Video-Language Temporal ...	2023-07-31	Code
19	UVCOM	43.18	No	Bridging the Gap: A Unified Video Comprehension ...	2023-11-28	Code
20	CG-DETR	42.86	No	Correlation-Guided Query-Dependency Calibration ...	2023-11-15	Code
21	QD-DETR (w/ PT)	40.62	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
22	QD-DETR (w/ audio)	40.19	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
23	BM-DETR	40.08	No	Background-aware Moment Detection for Video Mome...	2023-06-05	Code
24	QD-DETR (only Video w/ PT ASR Captions)	40	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
25	QD-DETR (only Video)	39.86	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
26	UMT (w/ audio + PT ASR Cpations)	38.08	No	UMT: Unified Multi-modal Transformers for Joint ...	2022-03-23	Code
27	Moment-DETR (w/ PT ASR Cpations)	36.14	No	QVHighlights: Detecting Moments and Highlights i...	2021-07-20	Code
28	UMT	36.12	No	UMT: Unified Multi-modal Transformers for Joint ...	2022-03-23	Code
29	UniVTG	35.47	No	UniVTG: Towards Unified Video-Language Temporal ...	2023-07-31	Code
30	SeViLA-Localizer	32.3	No	-	-	-
31	VTG-GPT	30.91	No	VTG-GPT: Tuning-Free Zero-Shot Video Temporal Gr...	2024-03-04	Code

#1SG-DETR (w/ PT)SOTA
58.8
mAP· Extra Data· 2024-10-02
Saliency-Guided DETR for Moment Retrieval and Highlight Detection Code
#2SG-DETR
54.1
mAP· 2024-10-02
Saliency-Guided DETR for Moment Retrieval and Highlight Detection Code
#3LLaVA-MR
52.73
mAP· 2024-11-21
LLaVA-MR: Large Language-and-Vision Assistant for Video Moment Retrieval Code
#4FlashVTG
52
mAP· 2024-12-18
FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding Code
#5InternVideo2-6BSOTA
49.24
mAP· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#6SG-DETR (ZS)
48.3
mAP· Extra Data· 2024-10-02
Saliency-Guided DETR for Moment Retrieval and Highlight Detection Code
#7CG-DETR (w/ PT)SOTA
47.97
mAP· Extra Data· 2023-11-15
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding Code
#8VideoLights-B-pt
47.94
mAP· Extra Data· 2024-12-02
VideoLights: Feature Refinement and Cross-Task Alignment Transformer for Joint Video Highlight Detection and Moment Retrieval Code
#9LA-DETR
47.93
mAP· 2024-12-30
Length-Aware DETR for Robust Moment Retrieval Code
#10BAM-DETR (w/ audio)
46.91
mAP· 2023-11-30
BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos Code
#11BAM-DETR (w/ PT ASR Captions)
46.67
mAP· Extra Data· 2023-11-30
BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos Code
#12LD-DETR
46.41
mAP· 2025-01-18
LD-DETR: Loop Decoder DEtection TRansformer for Video Moment Retrieval and Highlight Detection Code
#13R^2-Tuning
46.17
mAP· 2024-03-31
$R^2$-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding Code
#14BAM-DETR
45.36
mAP· 2023-11-30
BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos Code
#15video-mamba-suite
45.18
mAP· 2024-03-14
Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding Code
#16LLMEPET
44.05
mAP· 2024-07-21
Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval Code
#17UVCOM (w/ PT ASR Captions)
43.8
mAP· Extra Data· 2023-11-28
Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection Code
#18UniVTG (w/ PT)SOTA
43.63
mAP· Extra Data· 2023-07-31
UniVTG: Towards Unified Video-Language Temporal Grounding Code
#19UVCOM
43.18
mAP· 2023-11-28
Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection Code
#20CG-DETR
42.86
mAP· 2023-11-15
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding Code
#21QD-DETR (w/ PT)SOTA
40.62
mAP· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#22QD-DETR (w/ audio)
40.19
mAP· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#23BM-DETR
40.08
mAP· 2023-06-05
Background-aware Moment Detection for Video Moment Retrieval Code
#24QD-DETR (only Video w/ PT ASR Captions)
40
mAP· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#25QD-DETR (only Video)
39.86
mAP· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#26UMT (w/ audio + PT ASR Cpations)SOTA
38.08
mAP· 2022-03-23
UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection Code
#27Moment-DETR (w/ PT ASR Cpations)SOTA
36.14
mAP· 2021-07-20
QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries Code
#28UMT
36.12
mAP· 2022-03-23
UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection Code
#29UniVTG
35.47
mAP· 2023-07-31
UniVTG: Towards Unified Video-Language Temporal Grounding Code
#30SeViLA-Localizer
32.3
mAP
No paper
#31VTG-GPT
30.91
mAP· 2024-03-04
VTG-GPT: Tuning-Free Zero-Shot Video Temporal Grounding with GPT Code