Video Object Segmentation on YouTube-VOS 2018

Metric: F-Measure (Seen) (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	F-Measure (Seen)▼	Extra Data	Paper	Date↕	Code
1	Cutie+ (base, MEGA)	91	Yes	Putting the Object Back into Video Object Segmen...	2023-10-19	Code
2	SwinB-AOTv2-L (all frames, MS)	90.7	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
3	SwinB-DeAOT-L	90.6	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
4	XMem (BL30K, MS)	90.3	No	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
5	XMem (BL30K, MS)	90.3	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
6	R50-AOTv2-L (all frames)	90.2	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
7	SwinB-AOTv2-L (all frames)	90.1	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
8	SwinB-AOT-L (all frames)	90.1	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
9	XMem (MS)	89.9	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
10	R50-DeAOT-L	89.9	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
11	XMem (BL30K)	89.8	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
12	R50-AOT-L (all frames)	89.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
13	DeAOT-L	89.4	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
14	XMem	89.3	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
15	SwinB-AOT-L	89.3	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
16	DeAOT-B	88.9	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
17	R50-AOST (L'=3)	88.8	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
18	AOT-L (all frames)	88.8	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
19	AOT	88.5	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
20	R50-AOST (L'=2)	88.5	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
21	XMem (YouTubeVOS only)	88.5	No	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
22	R50-AOT-L	88.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
23	AOT-B (all frames)	88.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
24	DeAOT-S	88.3	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
25	RPCMVOS-MS	87.9	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
26	AOT-L	87.9	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
27	STCN	87.9	Yes	Rethinking Space-Time Networks with Improved Mem...	2021-06-09	Code
28	RAVOS	87.8	Yes	Region Aware Video Object Segmentation with Deep...	2022-07-21	-
29	RPCMVOS	87.7	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
30	RPCMVOS	87.7	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
31	QDMN	87.5	Yes	Learning Quality-aware Dynamic Memory for Video ...	2022-07-16	Code
32	AOT-B	87.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
33	AOT-S (all frames)	87	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
34	HMMN	87	Yes	Hierarchical Memory Matching Network for Video O...	2021-09-23	Code
35	TransVOS	86.7	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
36	AOT-S	86.7	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
37	CFBI+	86.6	No	Collaborative Video Object Segmentation by Multi...	2020-10-13	Code
38	CFBI+	86.6	No	Collaborative Video Object Segmentation by Multi...	2020-10-13	Code
39	STCN	86.5	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
40	DeAOT-T	86.3	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
41	R50-AOST (L'=1)	86.1	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
42	CFBI	85.8	No	Collaborative Video Object Segmentation by Foreg...	2020-03-18	Code
43	CFBI	85.8	No	Collaborative Video Object Segmentation by Foreg...	2020-03-18	Code
44	RMN	85.7	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
45	RMNet	85.7	Yes	Efficient Regional Memory Network for Video Obje...	2021-03-24	Code
46	KMN	85.6	No	Kernelized Memory Network for Video Object Segme...	2020-07-16	-
47	KMN	85.6	Yes	Kernelized Memory Network for Video Object Segme...	2020-07-16	Code
48	LWL	84.9	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
49	MiVOS	84.7	Yes	Modular Interactive Video Object Segmentation: I...	2021-03-14	Code
50	AOT-T (all frames)	84.7	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
51	AOT-T	84.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
52	STM	84.2	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
53	AFB-URR	83.1	No	Video Object Segmentation with Adaptive Feature ...	2020-10-15	Code
54	AFB-URR	83.1	Yes	Video Object Segmentation with Adaptive Feature ...	2020-10-15	Code
55	FRTM	76.2	No	Learning Fast and Robust Target Models for Video...	2020-02-27	Code
56	STM-cycle	75.8	No	Delving into the Cyclic Mechanism in Semi-superv...	2020-10-23	Code
57	SSM-VOS	73.3	No	-	-	Code
58	S2S	70	No	YouTube-VOS: Sequence-to-Sequence Video Object S...	2018-09-03	Code
59	MAMP	68.4	No	Self-Supervised Video Object Segmentation by Mot...	2021-07-27	Code
60	CapsuleVOS	68.1	No	CapsuleVOS: Semi-Supervised Video Object Segment...	2019-09-30	Code
61	RVOS	67.2	No	RVOS: End-to-End Recurrent Network for Video Obj...	2019-03-13	Code
62	e-OSVOS	66	Yes	Make One-Shot Video Object Segmentation Efficien...	2020-12-03	Code
63	OSVOS	60.5	No	One-Shot Video Object Segmentation	2016-11-16	Code
64	OSVOS	60.5	No	One-Shot Video Object Segmentation	2016-11-16	Code
65	OSMN	60.1	No	Efficient Video Object Segmentation via Network ...	2018-02-04	Code

#1Cutie+ (base, MEGA)SOTA
91
F-Measure (Seen)· Extra Data· 2023-10-19
Putting the Object Back into Video Object Segmentation Code
#2SwinB-AOTv2-L (all frames, MS)SOTA
90.7
F-Measure (Seen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#3SwinB-DeAOT-L
90.6
F-Measure (Seen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#4XMem (BL30K, MS)
90.3
F-Measure (Seen)· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#5XMem (BL30K, MS)
90.3
F-Measure (Seen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#6R50-AOTv2-L (all frames)
90.2
F-Measure (Seen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#7SwinB-AOTv2-L (all frames)
90.1
F-Measure (Seen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#8SwinB-AOT-L (all frames)SOTA
90.1
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#9XMem (MS)
89.9
F-Measure (Seen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#10R50-DeAOT-L
89.9
F-Measure (Seen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#11XMem (BL30K)
89.8
F-Measure (Seen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#12R50-AOT-L (all frames)
89.5
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#13DeAOT-L
89.4
F-Measure (Seen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#14XMem
89.3
F-Measure (Seen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#15SwinB-AOT-L
89.3
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#16DeAOT-B
88.9
F-Measure (Seen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#17R50-AOST (L'=3)
88.8
F-Measure (Seen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#18AOT-L (all frames)
88.8
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#19AOT
88.5
F-Measure (Seen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#20R50-AOST (L'=2)
88.5
F-Measure (Seen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#21XMem (YouTubeVOS only)
88.5
F-Measure (Seen)· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#22R50-AOT-L
88.5
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#23AOT-B (all frames)
88.5
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#24DeAOT-S
88.3
F-Measure (Seen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#25RPCMVOS-MS
87.9
F-Measure (Seen)· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#26AOT-L
87.9
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#27STCN
87.9
F-Measure (Seen)· Extra Data· 2021-06-09
Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentation Code
#28RAVOS
87.8
F-Measure (Seen)· Extra Data· 2022-07-21
Region Aware Video Object Segmentation with Deep Motion Modeling
#29RPCMVOS
87.7
F-Measure (Seen)· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#30RPCMVOS
87.7
F-Measure (Seen)· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#31QDMN
87.5
F-Measure (Seen)· Extra Data· 2022-07-16
Learning Quality-aware Dynamic Memory for Video Object Segmentation Code
#32AOT-B
87.5
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#33AOT-S (all frames)
87
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#34HMMN
87
F-Measure (Seen)· Extra Data· 2021-09-23
Hierarchical Memory Matching Network for Video Object Segmentation Code
#35TransVOS
86.7
F-Measure (Seen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#36AOT-S
86.7
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#37CFBI+SOTA
86.6
F-Measure (Seen)· 2020-10-13
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration Code
#38CFBI+
86.6
F-Measure (Seen)· 2020-10-13
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration Code
#39STCN
86.5
F-Measure (Seen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#40DeAOT-T
86.3
F-Measure (Seen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#41R50-AOST (L'=1)
86.1
F-Measure (Seen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#42CFBISOTA
85.8
F-Measure (Seen)· 2020-03-18
Collaborative Video Object Segmentation by Foreground-Background Integration Code
#43CFBI
85.8
F-Measure (Seen)· 2020-03-18
Collaborative Video Object Segmentation by Foreground-Background Integration Code
#44RMN
85.7
F-Measure (Seen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#45RMNet
85.7
F-Measure (Seen)· Extra Data· 2021-03-24
Efficient Regional Memory Network for Video Object Segmentation Code
#46KMN
85.6
F-Measure (Seen)· 2020-07-16
Kernelized Memory Network for Video Object Segmentation
#47KMN
85.6
F-Measure (Seen)· Extra Data· 2020-07-16
Kernelized Memory Network for Video Object Segmentation Code
#48LWL
84.9
F-Measure (Seen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#49MiVOS
84.7
F-Measure (Seen)· Extra Data· 2021-03-14
Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion Code
#50AOT-T (all frames)
84.7
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#51AOT-T
84.5
F-Measure (Seen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#52STM
84.2
F-Measure (Seen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#53AFB-URR
83.1
F-Measure (Seen)· 2020-10-15
Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement Code
#54AFB-URR
83.1
F-Measure (Seen)· Extra Data· 2020-10-15
Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement Code
#55FRTMSOTA
76.2
F-Measure (Seen)· 2020-02-27
Learning Fast and Robust Target Models for Video Object Segmentation Code
#56STM-cycle
75.8
F-Measure (Seen)· 2020-10-23
Delving into the Cyclic Mechanism in Semi-supervised Video Object Segmentation Code
#57SSM-VOS
73.3
F-Measure (Seen)
No paperCode
#58S2SSOTA
70
F-Measure (Seen)· 2018-09-03
YouTube-VOS: Sequence-to-Sequence Video Object Segmentation Code
#59MAMP
68.4
F-Measure (Seen)· 2021-07-27
Self-Supervised Video Object Segmentation by Motion-Aware Mask Propagation Code
#60CapsuleVOS
68.1
F-Measure (Seen)· 2019-09-30
CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing Code
#61RVOS
67.2
F-Measure (Seen)· 2019-03-13
RVOS: End-to-End Recurrent Network for Video Object Segmentation Code
#62e-OSVOS
66
F-Measure (Seen)· Extra Data· 2020-12-03
Make One-Shot Video Object Segmentation Efficient Again Code
#63OSVOSSOTA
60.5
F-Measure (Seen)· 2016-11-16
One-Shot Video Object Segmentation Code
#64OSVOS
60.5
F-Measure (Seen)· 2016-11-16
One-Shot Video Object Segmentation Code
#65OSMN
60.1
F-Measure (Seen)· 2018-02-04
Efficient Video Object Segmentation via Network Modulation Code