Instance Segmentation on A2D Sentences

Metric: Precision@0.7 (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	Precision@0.7▼	Extra Data	Paper	Date↕	Code
1	SgMg (Video-Swin-B)	0.767	Yes	Spectrum-guided Multi-granularity Referring Vide...	2023-07-25	Code
2	SOC (Video-Swin-B)	0.765	Yes	SOC: Semantic-Assisted Object Cluster for Referr...	2023-05-26	Code
3	ReferFormer (Video-Swin-B)	0.741	Yes	Language as Queries for Referring Video Object S...	2022-01-03	Code
4	SOC (Video-Swin-T)	0.687	No	SOC: Semantic-Assisted Object Cluster for Referr...	2023-05-26	Code
5	MTTR (w=10)	0.638	No	End-to-End Referring Video Object Segmentation w...	2021-11-29	Code
6	ClawCraneNet	0.617	No	ClawCraneNet: Leveraging Object-level Relation f...	2021-03-19	-
7	MTTR (w=8)	0.607	No	End-to-End Referring Video Object Segmentation w...	2021-11-29	Code
8	VLIDE	0.585	No	Deeply Interleaved Two-Stream Encoder for Referr...	2022-03-30	-
9	MANET	0.579	No	Multi-Attention Network for Compressed Video Ref...	2022-07-26	Code
10	Locater	0.525	No	Local-Global Context Aware Transformer for Langu...	2022-03-18	Code
11	mmmmtbvs	0.523	No	Modeling Motion with Multi-Modal Features for Te...	2022-04-06	Code
12	AAMN	0.523	No	Actor and Action Modular Network for Text-based ...	2020-11-02	-
13	CMPC-V (I3D)	0.506	No	Cross-Modal Progressive Comprehension for Referr...	2021-05-15	Code
14	Hui et al.	0.497	No	Collaborative Spatial-Temporal Modeling for Lang...	2021-05-14	-
15	HINet	0.486	No	-	-	-
16	PRPE	0.483	No	-	-	-
17	RefVOS	0.456	No	-	-	-
18	CMPC-V (R2D)	0.434	No	Cross-Modal Progressive Comprehension for Referr...	2021-05-15	Code
19	CMDy	0.405	No	-	-	-
20	CMSA+CFSA	0.358	No	Referring Segmentation in Images and Videos with...	2021-02-09	-
21	VT-Capsule	0.345	No	-	-	-
22	ACGA	0.319	No	-	-	Code
23	Gavriluyk el al. (Optical flow)	0.231	No	Actor and Action Video Segmentation from a Sente...	2018-03-20	Code
24	Gavriluyk el al.	0.211	No	Actor and Action Video Segmentation from a Sente...	2018-03-20	Code
25	Li et al.	0.175	No	-	-	-
26	Hu et al.	0.133	No	Segmentation from Natural Language Expressions	2016-03-20	Code

#1SgMg (Video-Swin-B)SOTA
0.767
Precision@0.7· Extra Data· 2023-07-25
Spectrum-guided Multi-granularity Referring Video Object Segmentation Code
#2SOC (Video-Swin-B)SOTA
0.765
Precision@0.7· Extra Data· 2023-05-26
SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentation Code
#3ReferFormer (Video-Swin-B)SOTA
0.741
Precision@0.7· Extra Data· 2022-01-03
Language as Queries for Referring Video Object Segmentation Code
#4SOC (Video-Swin-T)
0.687
Precision@0.7· 2023-05-26
SOC: Semantic-Assisted Object Cluster for Referring Video Object Segmentation Code
#5MTTR (w=10)SOTA
0.638
Precision@0.7· 2021-11-29
End-to-End Referring Video Object Segmentation with Multimodal Transformers Code
#6ClawCraneNetSOTA
0.617
Precision@0.7· 2021-03-19
ClawCraneNet: Leveraging Object-level Relation for Text-based Video Segmentation
#7MTTR (w=8)
0.607
Precision@0.7· 2021-11-29
End-to-End Referring Video Object Segmentation with Multimodal Transformers Code
#8VLIDE
0.585
Precision@0.7· 2022-03-30
Deeply Interleaved Two-Stream Encoder for Referring Video Segmentation
#9MANET
0.579
Precision@0.7· 2022-07-26
Multi-Attention Network for Compressed Video Referring Object Segmentation Code
#10Locater
0.525
Precision@0.7· 2022-03-18
Local-Global Context Aware Transformer for Language-Guided Video Segmentation Code
#11mmmmtbvs
0.523
Precision@0.7· 2022-04-06
Modeling Motion with Multi-Modal Features for Text-Based Video Segmentation Code
#12AAMNSOTA
0.523
Precision@0.7· 2020-11-02
Actor and Action Modular Network for Text-based Video Segmentation
#13CMPC-V (I3D)
0.506
Precision@0.7· 2021-05-15
Cross-Modal Progressive Comprehension for Referring Segmentation Code
#14Hui et al.
0.497
Precision@0.7· 2021-05-14
Collaborative Spatial-Temporal Modeling for Language-Queried Video Actor Segmentation
#15HINet
0.486
Precision@0.7
No paper
#16PRPE
0.483
Precision@0.7
No paper
#17RefVOS
0.456
Precision@0.7
No paper
#18CMPC-V (R2D)
0.434
Precision@0.7· 2021-05-15
Cross-Modal Progressive Comprehension for Referring Segmentation Code
#19CMDy
0.405
Precision@0.7
No paper
#20CMSA+CFSA
0.358
Precision@0.7· 2021-02-09
Referring Segmentation in Images and Videos with Cross-Modal Self-Attention Network
#21VT-Capsule
0.345
Precision@0.7
No paper
#22ACGA
0.319
Precision@0.7
No paperCode
#23Gavriluyk el al. (Optical flow)SOTA
0.231
Precision@0.7· 2018-03-20
Actor and Action Video Segmentation from a Sentence Code
#24Gavriluyk el al.
0.211
Precision@0.7· 2018-03-20
Actor and Action Video Segmentation from a Sentence Code
#25Li et al.
0.175
Precision@0.7
No paper
#26Hu et al.SOTA
0.133
Precision@0.7· 2016-03-20
Segmentation from Natural Language Expressions Code