Moment Retrieval on QVHighlights

Metric: R@1 IoU=0.7 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	R@1 IoU=0.7▼	Extra Data	Paper	Date↕	Code
1	LLaVA-MR	61.48	No	LLaVA-MR: Large Language-and-Vision Assistant fo...	2024-11-21	Code
2	SG-DETR (w/ PT)	60.4	Yes	Saliency-Guided DETR for Moment Retrieval and Hi...	2024-10-02	Code
3	SG-DETR	56.6	No	Saliency-Guided DETR for Moment Retrieval and Hi...	2024-10-02	Code
4	InternVideo2-6B	56.45	Yes	InternVideo2: Scaling Foundation Models for Mult...	2024-03-22	Code
5	VideoLights-B-pt	55.25	Yes	VideoLights: Feature Refinement and Cross-Task A...	2024-12-02	Code
6	FlashVTG	53.96	No	FlashVTG: Feature Layering and Adaptive Score Ha...	2024-12-18	Code
7	CG-DETR (w/ PT)	53.11	Yes	Correlation-Guided Query-Dependency Calibration ...	2023-11-15	Code
8	video-mamba-suite	52.19	No	Video Mamba Suite: State Space Model as a Versat...	2024-03-14	Code
9	LA-DETR	51.1	No	Length-Aware DETR for Robust Moment Retrieval	2024-12-30	Code
10	LD-DETR	51.04	No	LD-DETR: Loop Decoder DEtection TRansformer for ...	2025-01-18	Code
11	UniVTG (w/ PT)	50.06	Yes	UniVTG: Towards Unified Video-Language Temporal ...	2023-07-31	Code
12	LLMEPET	49.94	No	Prior Knowledge Integration via LLM Encoding and...	2024-07-21	Code
13	R^2-Tuning	49.35	No	$R^2$-Tuning: Efficient Image-to-Video Transfer ...	2024-03-31	Code
14	UnLoc-B	48.8	No	UnLoc: A Unified Framework for Video Localizatio...	2023-08-21	Code
15	BAM-DETR	48.64	No	BAM-DETR: Boundary-Aligned Moment Detection Tran...	2023-11-30	Code
16	CG-DETR	48.38	No	Correlation-Guided Query-Dependency Calibration ...	2023-11-15	Code
17	UVCOM (w/ PT ASR Captions)	48.31	Yes	Bridging the Gap: A Unified Video Comprehension ...	2023-11-28	Code
18	BAM-DETR (w/ audio)	48.12	No	BAM-DETR: Boundary-Aligned Moment Detection Tran...	2023-11-30	Code
19	BAM-DETR (w/ PT ASR Captions)	47.92	Yes	BAM-DETR: Boundary-Aligned Moment Detection Tran...	2023-11-30	Code
20	UVCOM	47.47	No	Bridging the Gap: A Unified Video Comprehension ...	2023-11-28	Code
21	UnLoc-L	46.7	No	UnLoc: A Unified Framework for Video Localizatio...	2023-08-21	Code
22	QD-DETR (w/ PT)	46.1	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
23	QD-DETR (only Video w/ PT ASR Captions)	45.2	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
24	QD-DETR (w/ audio)	45.1	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
25	DenoiseLoc	45.07	No	Boundary-Denoising for Video Activity Localization	2023-04-06	Code
26	QD-DETR (only Video)	44.98	No	Query-Dependent Video Representation for Moment ...	2023-03-24	Code
27	BM-DETR	43.05	No	Background-aware Moment Detection for Video Mome...	2023-06-05	Code
28	UniVTG	40.86	No	UniVTG: Towards Unified Video-Language Temporal ...	2023-07-31	Code
29	Moment-DETR (w/ PT ASR Cpations)	40.33	No	QVHighlights: Detecting Moments and Highlights i...	2021-07-20	Code
30	SeViLA-Localizer	36.5	No	-	-	-

#1LLaVA-MRSOTA
61.48
R@1 IoU=0.7· 2024-11-21
LLaVA-MR: Large Language-and-Vision Assistant for Video Moment Retrieval Code
#2SG-DETR (w/ PT)SOTA
60.4
R@1 IoU=0.7· Extra Data· 2024-10-02
Saliency-Guided DETR for Moment Retrieval and Highlight Detection Code
#3SG-DETR
56.6
R@1 IoU=0.7· 2024-10-02
Saliency-Guided DETR for Moment Retrieval and Highlight Detection Code
#4InternVideo2-6BSOTA
56.45
R@1 IoU=0.7· Extra Data· 2024-03-22
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding Code
#5VideoLights-B-pt
55.25
R@1 IoU=0.7· Extra Data· 2024-12-02
VideoLights: Feature Refinement and Cross-Task Alignment Transformer for Joint Video Highlight Detection and Moment Retrieval Code
#6FlashVTG
53.96
R@1 IoU=0.7· 2024-12-18
FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding Code
#7CG-DETR (w/ PT)SOTA
53.11
R@1 IoU=0.7· Extra Data· 2023-11-15
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding Code
#8video-mamba-suite
52.19
R@1 IoU=0.7· 2024-03-14
Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding Code
#9LA-DETR
51.1
R@1 IoU=0.7· 2024-12-30
Length-Aware DETR for Robust Moment Retrieval Code
#10LD-DETR
51.04
R@1 IoU=0.7· 2025-01-18
LD-DETR: Loop Decoder DEtection TRansformer for Video Moment Retrieval and Highlight Detection Code
#11UniVTG (w/ PT)SOTA
50.06
R@1 IoU=0.7· Extra Data· 2023-07-31
UniVTG: Towards Unified Video-Language Temporal Grounding Code
#12LLMEPET
49.94
R@1 IoU=0.7· 2024-07-21
Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval Code
#13R^2-Tuning
49.35
R@1 IoU=0.7· 2024-03-31
$R^2$-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding Code
#14UnLoc-B
48.8
R@1 IoU=0.7· 2023-08-21
UnLoc: A Unified Framework for Video Localization Tasks Code
#15BAM-DETR
48.64
R@1 IoU=0.7· 2023-11-30
BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos Code
#16CG-DETR
48.38
R@1 IoU=0.7· 2023-11-15
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding Code
#17UVCOM (w/ PT ASR Captions)
48.31
R@1 IoU=0.7· Extra Data· 2023-11-28
Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection Code
#18BAM-DETR (w/ audio)
48.12
R@1 IoU=0.7· 2023-11-30
BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos Code
#19BAM-DETR (w/ PT ASR Captions)
47.92
R@1 IoU=0.7· Extra Data· 2023-11-30
BAM-DETR: Boundary-Aligned Moment Detection Transformer for Temporal Sentence Grounding in Videos Code
#20UVCOM
47.47
R@1 IoU=0.7· 2023-11-28
Bridging the Gap: A Unified Video Comprehension Framework for Moment Retrieval and Highlight Detection Code
#21UnLoc-L
46.7
R@1 IoU=0.7· 2023-08-21
UnLoc: A Unified Framework for Video Localization Tasks Code
#22QD-DETR (w/ PT)SOTA
46.1
R@1 IoU=0.7· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#23QD-DETR (only Video w/ PT ASR Captions)
45.2
R@1 IoU=0.7· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#24QD-DETR (w/ audio)
45.1
R@1 IoU=0.7· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#25DenoiseLoc
45.07
R@1 IoU=0.7· 2023-04-06
Boundary-Denoising for Video Activity Localization Code
#26QD-DETR (only Video)
44.98
R@1 IoU=0.7· 2023-03-24
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection Code
#27BM-DETR
43.05
R@1 IoU=0.7· 2023-06-05
Background-aware Moment Detection for Video Moment Retrieval Code
#28UniVTG
40.86
R@1 IoU=0.7· 2023-07-31
UniVTG: Towards Unified Video-Language Temporal Grounding Code
#29Moment-DETR (w/ PT ASR Cpations)SOTA
40.33
R@1 IoU=0.7· 2021-07-20
QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queries Code
#30SeViLA-Localizer
36.5
R@1 IoU=0.7
No paper