Referring Expression Segmentation on J-HMDB

Metric: Precision@0.6 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	Precision@0.6▼	Extra Data	Paper	Date↕	Code
1	SgMg (Video-Swin-B)	0.917	Yes	Spectrum-guided Multi-granularity Referring Vide...	2023-07-25	Code
2	SOC (Video-Swin-B)	0.914	Yes	SOC: Semantic-Assisted Object Cluster for Referr...	2023-05-26	Code
3	SOC (Video-Swin-T)	0.864	No	SOC: Semantic-Assisted Object Cluster for Referr...	2023-05-26	Code
4	MTTR (w=10)	0.852	No	End-to-End Referring Video Object Segmentation w...	2021-11-29	Code
5	MTTR (w=8)	0.815	No	End-to-End Referring Video Object Segmentation w...	2021-11-29	Code
6	ClawCraneNet	0.796	No	ClawCraneNet: Leveraging Object-level Relation f...	2021-03-19	-
7	VLIDE	0.791	No	Deeply Interleaved Two-Stream Encoder for Referr...	2022-03-30	-
8	HINet	0.736	No	-	-	-
9	PRPE	0.69	No	-	-	-
10	CMPC-V	0.657	No	Cross-Modal Progressive Comprehension for Referr...	2021-05-15	Code
11	Hui et al.	0.639	No	Collaborative Spatial-Temporal Modeling for Lang...	2021-05-14	-
12	AAMN	0.627	No	Actor and Action Modular Network for Text-based ...	2020-11-02	-
13	CMSA+CFSA	0.625	No	Referring Segmentation in Images and Videos with...	2021-02-09	-
14	RefVOS	0.62	No	-	-	-
15	CMDy	0.587	No	-	-	-
16	ACGA	0.564	No	-	-	Code
17	Gavrilyuk et al. (Optical flow)	0.518	No	Actor and Action Video Segmentation from a Sente...	2018-03-20	Code
18	VT-Capsule	0.513	No	-	-	-
19	Gavrilyuk et al.	0.46	No	Actor and Action Video Segmentation from a Sente...	2018-03-20	Code
20	Hu et al.	0.35	No	Segmentation from Natural Language Expressions	2016-03-20	Code
21	Li et al.	0.335	No	-	-	-

#1SgMg (Video-Swin-B)SOTA
0.917
Precision@0.6· Extra Data· 2023-07-25
Spectrum-guided Multi-granularity Referring Video Object Segmentation Code
#2SOC (Video-Swin-B)SOTA
0.914
Precision@0.6· Extra Data· 2023-05-26
SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentation Code
#3SOC (Video-Swin-T)
0.864
Precision@0.6· 2023-05-26
SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentation Code
#4MTTR (w=10)SOTA
0.852
Precision@0.6· 2021-11-29
End-to-End Referring Video Object Segmentation with Multimodal Transformers Code
#5MTTR (w=8)
0.815
Precision@0.6· 2021-11-29
End-to-End Referring Video Object Segmentation with Multimodal Transformers Code
#6ClawCraneNetSOTA
0.796
Precision@0.6· 2021-03-19
ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentation
#7VLIDE
0.791
Precision@0.6· 2022-03-30
Deeply Interleaved Two-Stream Encoder for Referring Video Segmentation
#8HINet
0.736
Precision@0.6
No paper
#9PRPE
0.69
Precision@0.6
No paper
#10CMPC-V
0.657
Precision@0.6· 2021-05-15
Cross-Modal Progressive Comprehension for Referring Segmentation Code
#11Hui et al.
0.639
Precision@0.6· 2021-05-14
Collaborative Spatial-Temporal Modeling for Language-Queried Video Actor Segmentation
#12AAMNSOTA
0.627
Precision@0.6· 2020-11-02
Actor and Action Modular Network for Text-based Video Segmentation
#13CMSA+CFSA
0.625
Precision@0.6· 2021-02-09
Referring Segmentation in Images and Videos with Cross-Modal Self-Attention Network
#14RefVOS
0.62
Precision@0.6
No paper
#15CMDy
0.587
Precision@0.6
No paper
#16ACGA
0.564
Precision@0.6
No paperCode
#17Gavrilyuk et al. (Optical flow)SOTA
0.518
Precision@0.6· 2018-03-20
Actor and Action Video Segmentation from a Sentence Code
#18VT-Capsule
0.513
Precision@0.6
No paper
#19Gavrilyuk et al.
0.46
Precision@0.6· 2018-03-20
Actor and Action Video Segmentation from a Sentence Code
#20Hu et al.SOTA
0.35
Precision@0.6· 2016-03-20
Segmentation from Natural Language Expressions Code
#21Li et al.
0.335
Precision@0.6
No paper