Semi-Supervised Video Object Segmentation on YouTube-VOS 2018

Metric: F-Measure (Unseen) (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	F-Measure (Unseen)▼	Extra Data	Paper	Date↕	Code
1	XMem (BL30K, MS)	90.2	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
2	Cutie+ (base, MEGA)	90.1	Yes	Putting the Object Back into Video Object Segmen...	2023-10-19	Code
3	XMem (MS)	89.9	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
4	XMem (BL30K)	89.2	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
5	SwinB-AOTv2-L (all frames, MS)	88.9	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
6	R50-DeAOT-L	88.7	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
7	XMem	88.7	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
8	SwinB-DeAOT-L	88.4	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
9	SwinB-AOTv2-L (all frames)	88.2	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
10	R50-AOT-L (all frames)	88.2	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
11	R50-AOST (L'=3)	87.9	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
12	RAVOS	87.4	Yes	Region Aware Video Object Segmentation with Deep...	2022-07-21	-
13	R50-AOTv2-L (all frames)	87.3	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
14	STCN	87.3	Yes	Rethinking Space-Time Networks with Improved Mem...	2021-06-09	Code
15	R50-AOST (L'=2)	87.2	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
16	XMem (YouTubeVOS only)	87.2	No	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
17	AOT-L (all frames)	87.1	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
18	DeAOT-B	87	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
19	SwinB-AOT-L (all frames)	86.9	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
20	RPCMVOS-MS	86.9	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
21	RPCMVOS	86.7	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
22	DeAOT-S	86.6	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
23	AOT-B (all frames)	86.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
24	AOT-L	86.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
25	SwinB-AOT-L	86.4	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
26	QDMN	86.4	Yes	Learning Quality-aware Dynamic Memory for Video ...	2022-07-16	Code
27	R50-AOT-L	86.1	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
28	AOT-B	86	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
29	AOT-S (all frames)	85.7	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
30	CFBI+	85.6	No	Collaborative Video Object Segmentation by Multi...	2020-10-13	Code
31	MiVOS	85.5	Yes	Modular Interactive Video Object Segmentation: I...	2021-03-14	Code
32	AOT-S	85	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
33	HMMN	84.6	Yes	Hierarchical Memory Matching Network for Video O...	2021-09-23	Code
34	DeAOT-T	84.2	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
35	R50-AOST (L'=1)	83.5	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
36	AOT-T (all frames)	83.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
37	CFBI	83.4	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	Code
38	KMN	83.3	Yes	Kernelized Memory Network for Video Object Segme...	2020-07-16	Code
39	AFB-URR	82.6	Yes	Video Object Segmentation with Adaptive Feature ...	2020-10-15	Code
40	RMNet	82.4	Yes	Efficient Regional Memory Network for Video Obje...	2021-03-24	Code
41	AOT-T	82.2	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
42	FRTM	74.1	No	Learning Fast and Robust Target Models for Video...	2020-02-27	Code
43	e-OSVOS	73.8	Yes	Make One-Shot Video Object Segmentation Efficien...	2020-12-03	Code
44	MAMP	73.2	No	Self-Supervised Video Object Segmentation by Mot...	2021-07-27	Code
45	STM-cycle	70.4	No	Delving into the Cyclic Mechanism in Semi-superv...	2020-10-23	Code
46	SSM-VOS	62.6	No	-	-	Code
47	S2S	61.2	No	YouTube-VOS: Sequence-to-Sequence Video Object S...	2018-09-03	Code
48	OSVOS	60.7	No	One-Shot Video Object Segmentation	2016-11-16	Code
49	CapsuleVOS	59.9	No	CapsuleVOS: Semi-Supervised Video Object Segment...	2019-09-30	Code
50	RVOS	51	No	RVOS: End-to-End Recurrent Network for Video Obj...	2019-03-13	Code
51	OSMN	44	No	Efficient Video Object Segmentation via Network ...	2018-02-04	Code

#1XMem (BL30K, MS)SOTA
90.2
F-Measure (Unseen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#2Cutie+ (base, MEGA)
90.1
F-Measure (Unseen)· Extra Data· 2023-10-19
Putting the Object Back into Video Object Segmentation Code
#3XMem (MS)
89.9
F-Measure (Unseen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#4XMem (BL30K)
89.2
F-Measure (Unseen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#5SwinB-AOTv2-L (all frames, MS)SOTA
88.9
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#6R50-DeAOT-L
88.7
F-Measure (Unseen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#7XMem
88.7
F-Measure (Unseen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#8SwinB-DeAOT-L
88.4
F-Measure (Unseen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#9SwinB-AOTv2-L (all frames)
88.2
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#10R50-AOT-L (all frames)SOTA
88.2
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#11R50-AOST (L'=3)
87.9
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#12RAVOS
87.4
F-Measure (Unseen)· Extra Data· 2022-07-21
Region Aware Video Object Segmentation with Deep Motion Modeling
#13R50-AOTv2-L (all frames)
87.3
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#14STCN
87.3
F-Measure (Unseen)· Extra Data· 2021-06-09
Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentation Code
#15R50-AOST (L'=2)
87.2
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#16XMem (YouTubeVOS only)
87.2
F-Measure (Unseen)· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#17AOT-L (all frames)
87.1
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#18DeAOT-B
87
F-Measure (Unseen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#19SwinB-AOT-L (all frames)
86.9
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#20RPCMVOS-MS
86.9
F-Measure (Unseen)· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#21RPCMVOS
86.7
F-Measure (Unseen)· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#22DeAOT-S
86.6
F-Measure (Unseen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#23AOT-B (all frames)
86.5
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#24AOT-L
86.5
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#25SwinB-AOT-L
86.4
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#26QDMN
86.4
F-Measure (Unseen)· Extra Data· 2022-07-16
Learning Quality-aware Dynamic Memory for Video Object Segmentation Code
#27R50-AOT-L
86.1
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#28AOT-B
86
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#29AOT-S (all frames)
85.7
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#30CFBI+SOTA
85.6
F-Measure (Unseen)· 2020-10-13
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration Code
#31MiVOS
85.5
F-Measure (Unseen)· Extra Data· 2021-03-14
Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion Code
#32AOT-S
85
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#33HMMN
84.6
F-Measure (Unseen)· Extra Data· 2021-09-23
Hierarchical Memory Matching Network for Video Object Segmentation Code
#34DeAOT-T
84.2
F-Measure (Unseen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#35R50-AOST (L'=1)
83.5
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#36AOT-T (all frames)
83.5
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#37CFBI
83.4
F-Measure (Unseen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation Code
#38KMNSOTA
83.3
F-Measure (Unseen)· Extra Data· 2020-07-16
Kernelized Memory Network for Video Object Segmentation Code
#39AFB-URR
82.6
F-Measure (Unseen)· Extra Data· 2020-10-15
Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement Code
#40RMNet
82.4
F-Measure (Unseen)· Extra Data· 2021-03-24
Efficient Regional Memory Network for Video Object Segmentation Code
#41AOT-T
82.2
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#42FRTMSOTA
74.1
F-Measure (Unseen)· 2020-02-27
Learning Fast and Robust Target Models for Video Object Segmentation Code
#43e-OSVOS
73.8
F-Measure (Unseen)· Extra Data· 2020-12-03
Make One-Shot Video Object Segmentation Efficient Again Code
#44MAMP
73.2
F-Measure (Unseen)· 2021-07-27
Self-Supervised Video Object Segmentation by Motion-Aware Mask Propagation Code
#45STM-cycle
70.4
F-Measure (Unseen)· 2020-10-23
Delving into the Cyclic Mechanism in Semi-supervised Video Object Segmentation Code
#46SSM-VOS
62.6
F-Measure (Unseen)
No paperCode
#47S2SSOTA
61.2
F-Measure (Unseen)· 2018-09-03
YouTube-VOS: Sequence-to-Sequence Video Object Segmentation Code
#48OSVOSSOTA
60.7
F-Measure (Unseen)· 2016-11-16
One-Shot Video Object Segmentation Code
#49CapsuleVOS
59.9
F-Measure (Unseen)· 2019-09-30
CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing Code
#50RVOS
51
F-Measure (Unseen)· 2019-03-13
RVOS: End-to-End Recurrent Network for Video Object Segmentation Code
#51OSMN
44
F-Measure (Unseen)· 2018-02-04
Efficient Video Object Segmentation via Network Modulation Code