Moment Retrieval on QVHighlights

Metric: mAP@0.75 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	mAP@0.75▼	Extra Data	Paper	Date↕	Code
1	SG-DETR (w/ PT)	60.8	Yes	Saliency-Guided DETR for Moment Retrieval and Hi...	2024-10-02	Code
2	SG-DETR	55.8	No	Saliency-Guided DETR for Moment Retrieval and Hi...	2024-10-02	Code
3	LLaVA-MR	54.4	No	LLaVA-MR: Large Language-and-Vision Assistant fo...	2024-11-21	Code
4	FlashVTG	53.85	No	FlashVTG: Feature Layering and Adaptive Score Ha...	2024-12-18	Code
5	LA-DETR	49.44	No	Length-Aware DETR for Robust Moment Retrieval	2024-12-30	Code
6	VideoLights-B-pt	49.17	Yes	VideoLights: Feature Refinement and Cross-Task A...	2024-12-02	Code
7	CG-DETR (w/ PT)	49.12	Yes	Correlation-Guided Query-Dependency Calibration ...	2023-11-15	Code
8	SG-DETR (ZS)	49	Yes	Saliency-Guided DETR for Moment Retrieval and Hi...	2024-10-02	Code
9	BAM-DETR (w/ PT ASR Captions)	48.22	Yes	BAM-DETR: Boundary-Aligned Moment Detection Tran...	2023-11-30	Code
10	R^2-Tuning	47.56	No	$R^2$-Tuning: Efficient Image-to-Video Transfer ...	2024-03-31	Code
11	BAM-DETR (w/ audio)	47.51	No	BAM-DETR: Boundary-Aligned Moment Detection Tran...	2023-11-30	Code
12	LD-DETR	46.99	No	LD-DETR: Loop Decoder DEtection TRansformer for ...	2025-01-18	Code
13	video-mamba-suite	46.68	No	Video Mamba Suite: State Space Model as a Versat...	2024-03-14	Code
14	BAM-DETR	46.33	No	BAM-DETR: Boundary-Aligned Moment Detection Tran...	2023-11-30	Code
15	UniVTG (w/ PT)	45.02	Yes	UniVTG: Towards Unified Video-Language Temporal ...	2023-07-31	Code
16	LLMEPET	43.91	No	Prior Knowledge Integration via LLM Encoding and...	2024-07-21	Code
17	UVCOM (w/ PT ASR Captions)	43.65	Yes	Bridging the Gap: A Unified Video Comprehension ...	2023-11-28	Code
18	CG-DETR	42.77	No	Correlation-Guided Query-Dependency Calibration ...	2023-11-15	Code
19	UVCOM	42.67	No	Bridging the Gap: A Unified Video Comprehension ...	2023-11-28	Code
20	QD-DETR (w/ PT)	40.5	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
21	QD-DETR (only Video w/ PT ASR Captions)	40.4	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
22	BM-DETR	40.18	No	Background-aware Moment Detection for Video Mome...	2023-06-05	Code
23	QD-DETR (w/ audio)	40.1	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
24	QD-DETR (only Video)	39.88	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
25	UniVTG	35.59	No	UniVTG: Towards Unified Video-Language Temporal ...	2023-07-31	Code
26	Moment-DETR (w/ PT ASR Cpations)	35.36	No	QVHighlights: Detecting Moments and Highlights i...	2021-07-20	Code
27	VTG-GPT	29.73	No	VTG-GPT: Tuning-Free Zero-Shot Video Temporal Gr...	2024-03-04	Code

#1SG-DETR (w/ PT)SOTA
60.8
mAP@0.75· Extra Data· 2024-10-02
Saliency-Guided DETR for Moment Retrieval and Highlight Detection Code
#2SG-DETR
55.8
mAP@0.75· 2024-10-02
Saliency-Guided DETR for Moment Retrieval and Highlight Detection Code
#3LLaVA-MR
54.4
mAP@0.75· 2024-11-21
LLaVA-MR: Large Language-and-Vision Assistant for Video Moment Retrieval Code
#4FlashVTG
53.85
mAP@0.75· 2024-12-18
FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding Code
#5LA-DETR
49.44
mAP@0.75· 2024-12-30
Length-Aware DETR for Robust Moment Retrieval Code
#6VideoLights-B-pt
49.17
mAP@0.75· Extra Data· 2024-12-02
VideoLights: Feature Refinement and Cross-Task Alignment Transformer for Joint Video Highlight Detection and Moment Retrieval Code
#7CG-DETR (w/ PT)SOTA
49.12
mAP@0.75· Extra Data· 2023-11-15
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding Code
#8SG-DETR (ZS)
49
mAP@0.75· Extra Data· 2024-10-02
Saliency-Guided DETR for Moment Retrieval and Highlight Detection Code
#9BAM-DETR (w/ PT ASR Captions)
48.22
mAP@0.75· Extra Data· 2023-11-30
BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos Code
#10R^2-Tuning
47.56
mAP@0.75· 2024-03-31
$R^2$-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding Code
#11BAM-DETR (w/ audio)
47.51
mAP@0.75· 2023-11-30
BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos Code
#12LD-DETR
46.99
mAP@0.75· 2025-01-18
LD-DETR: Loop Decoder DEtection TRansformer for Video Moment Retrieval and Highlight Detection Code
#13video-mamba-suite
46.68
mAP@0.75· 2024-03-14
Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding Code
#14BAM-DETR
46.33
mAP@0.75· 2023-11-30
BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos Code
#15UniVTG (w/ PT)SOTA
45.02
mAP@0.75· Extra Data· 2023-07-31
UniVTG: Towards Unified Video-Language Temporal Grounding Code
#16LLMEPET
43.91
mAP@0.75· 2024-07-21
Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval Code
#17UVCOM (w/ PT ASR Captions)
43.65
mAP@0.75· Extra Data· 2023-11-28
Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection Code
#18CG-DETR
42.77
mAP@0.75· 2023-11-15
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding Code
#19UVCOM
42.67
mAP@0.75· 2023-11-28
Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection Code
#20QD-DETR (w/ PT)SOTA
40.5
mAP@0.75· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#21QD-DETR (only Video w/ PT ASR Captions)
40.4
mAP@0.75· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#22BM-DETR
40.18
mAP@0.75· 2023-06-05
Background-aware Moment Detection for Video Moment Retrieval Code
#23QD-DETR (w/ audio)
40.1
mAP@0.75· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#24QD-DETR (only Video)
39.88
mAP@0.75· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#25UniVTG
35.59
mAP@0.75· 2023-07-31
UniVTG: Towards Unified Video-Language Temporal Grounding Code
#26Moment-DETR (w/ PT ASR Cpations)SOTA
35.36
mAP@0.75· 2021-07-20
QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries Code
#27VTG-GPT
29.73
mAP@0.75· 2024-03-04
VTG-GPT: Tuning-Free Zero-Shot Video Temporal Grounding with GPT Code