Video Object Segmentation on YouTube-VOS 2018

Metric: F-Measure (Unseen) (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	F-Measure (Unseen)▼	Extra Data	Paper	Date↕	Code
1	XMem (BL30K, MS)	90.2	No	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
2	XMem (BL30K, MS)	90.2	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
3	Cutie+ (base, MEGA)	90.1	Yes	Putting the Object Back into Video Object Segmen...	2023-10-19	Code
4	XMem (MS)	89.9	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
5	XMem (BL30K)	89.2	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
6	SwinB-AOTv2-L (all frames, MS)	88.9	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
7	R50-DeAOT-L	88.7	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
8	XMem	88.7	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
9	SwinB-DeAOT-L	88.4	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
10	SwinB-AOTv2-L (all frames)	88.2	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
11	R50-AOT-L (all frames)	88.2	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
12	R50-AOST (L'=3)	87.9	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
13	RAVOS	87.4	Yes	Region Aware Video Object Segmentation with Deep...	2022-07-21	-
14	R50-AOTv2-L (all frames)	87.3	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
15	STCN	87.3	Yes	Rethinking Space-Time Networks with Improved Mem...	2021-06-09	Code
16	R50-AOST (L'=2)	87.2	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
17	XMem (YouTubeVOS only)	87.2	No	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
18	AOT-L (all frames)	87.1	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
19	DeAOT-B	87	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
20	SwinB-AOT-L (all frames)	86.9	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
21	RPCMVOS-MS	86.9	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
22	RPCMVOS	86.7	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
23	RPCMVOS	86.7	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
24	DeAOT-S	86.6	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
25	AOT-B (all frames)	86.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
26	AOT-L	86.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
27	SwinB-AOT-L	86.4	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
28	QDMN	86.4	Yes	Learning Quality-aware Dynamic Memory for Video ...	2022-07-16	Code
29	AOT	86.1	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
30	R50-AOT-L	86.1	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
31	AOT-B	86	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
32	STCN	85.7	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
33	AOT-S (all frames)	85.7	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
34	CFBI+	85.6	No	Collaborative Video Object Segmentation by Multi...	2020-10-13	Code
35	CFBI+	85.6	No	Collaborative Video Object Segmentation by Multi...	2020-10-13	Code
36	MiVOS	85.5	Yes	Modular Interactive Video Object Segmentation: I...	2021-03-14	Code
37	AOT-S	85	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
38	HMMN	84.6	Yes	Hierarchical Memory Matching Network for Video O...	2021-09-23	Code
39	LWL	84.4	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
40	DeAOT-T	84.2	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
41	R50-AOST (L'=1)	83.5	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
42	AOT-T (all frames)	83.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
43	TransVOS	83.4	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
44	CFBI	83.4	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	Code
45	KMN	83.3	No	Kernelized Memory Network for Video Object Segme...	2020-07-16	-
46	KMN	83.3	Yes	Kernelized Memory Network for Video Object Segme...	2020-07-16	Code
47	AFB-URR	82.6	No	Video Object Segmentation with Adaptive Feature ...	2020-10-15	Code
48	AFB-URR	82.6	Yes	Video Object Segmentation with Adaptive Feature ...	2020-10-15	Code
49	RMN	82.4	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
50	RMNet	82.4	Yes	Efficient Regional Memory Network for Video Obje...	2021-03-24	Code
51	AOT-T	82.2	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
52	STM	80.9	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
53	FRTM	74.1	No	Learning Fast and Robust Target Models for Video...	2020-02-27	Code
54	e-OSVOS	73.8	Yes	Make One-Shot Video Object Segmentation Efficien...	2020-12-03	Code
55	MAMP	73.2	No	Self-Supervised Video Object Segmentation by Mot...	2021-07-27	Code
56	STM-cycle	70.4	No	Delving into the Cyclic Mechanism in Semi-superv...	2020-10-23	Code
57	SSM-VOS	62.6	No	-	-	Code
58	S2S	61.2	No	YouTube-VOS: Sequence-to-Sequence Video Object S...	2018-09-03	Code
59	OSVOS	60.7	No	One-Shot Video Object Segmentation	2016-11-16	Code
60	CapsuleVOS	59.9	No	CapsuleVOS: Semi-Supervised Video Object Segment...	2019-09-30	Code
61	RVOS	51	No	RVOS: End-to-End Recurrent Network for Video Obj...	2019-03-13	Code
62	S2S (offline)	50.3	No	YouTube-VOS: Sequence-to-Sequence Video Object S...	2018-09-03	Code
63	OSMN	44	No	Efficient Video Object Segmentation via Network ...	2018-02-04	Code

#1XMem (BL30K, MS)SOTA
90.2
F-Measure (Unseen)· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#2XMem (BL30K, MS)
90.2
F-Measure (Unseen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#3Cutie+ (base, MEGA)
90.1
F-Measure (Unseen)· Extra Data· 2023-10-19
Putting the Object Back into Video Object Segmentation Code
#4XMem (MS)
89.9
F-Measure (Unseen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#5XMem (BL30K)
89.2
F-Measure (Unseen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#6SwinB-AOTv2-L (all frames, MS)SOTA
88.9
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#7R50-DeAOT-L
88.7
F-Measure (Unseen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#8XMem
88.7
F-Measure (Unseen)· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#9SwinB-DeAOT-L
88.4
F-Measure (Unseen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#10SwinB-AOTv2-L (all frames)
88.2
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#11R50-AOT-L (all frames)SOTA
88.2
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#12R50-AOST (L'=3)
87.9
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#13RAVOS
87.4
F-Measure (Unseen)· Extra Data· 2022-07-21
Region Aware Video Object Segmentation with Deep Motion Modeling
#14R50-AOTv2-L (all frames)
87.3
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#15STCN
87.3
F-Measure (Unseen)· Extra Data· 2021-06-09
Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentation Code
#16R50-AOST (L'=2)
87.2
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#17XMem (YouTubeVOS only)
87.2
F-Measure (Unseen)· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#18AOT-L (all frames)
87.1
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#19DeAOT-B
87
F-Measure (Unseen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#20SwinB-AOT-L (all frames)
86.9
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#21RPCMVOS-MS
86.9
F-Measure (Unseen)· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#22RPCMVOS
86.7
F-Measure (Unseen)· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#23RPCMVOS
86.7
F-Measure (Unseen)· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#24DeAOT-S
86.6
F-Measure (Unseen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#25AOT-B (all frames)
86.5
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#26AOT-L
86.5
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#27SwinB-AOT-L
86.4
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#28QDMN
86.4
F-Measure (Unseen)· Extra Data· 2022-07-16
Learning Quality-aware Dynamic Memory for Video Object Segmentation Code
#29AOT
86.1
F-Measure (Unseen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#30R50-AOT-L
86.1
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#31AOT-B
86
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#32STCN
85.7
F-Measure (Unseen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#33AOT-S (all frames)
85.7
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#34CFBI+SOTA
85.6
F-Measure (Unseen)· 2020-10-13
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration Code
#35CFBI+
85.6
F-Measure (Unseen)· 2020-10-13
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration Code
#36MiVOS
85.5
F-Measure (Unseen)· Extra Data· 2021-03-14
Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion Code
#37AOT-S
85
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#38HMMN
84.6
F-Measure (Unseen)· Extra Data· 2021-09-23
Hierarchical Memory Matching Network for Video Object Segmentation Code
#39LWL
84.4
F-Measure (Unseen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#40DeAOT-T
84.2
F-Measure (Unseen)· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#41R50-AOST (L'=1)
83.5
F-Measure (Unseen)· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#42AOT-T (all frames)
83.5
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#43TransVOS
83.4
F-Measure (Unseen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#44CFBI
83.4
F-Measure (Unseen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation Code
#45KMNSOTA
83.3
F-Measure (Unseen)· 2020-07-16
Kernelized Memory Network for Video Object Segmentation
#46KMN
83.3
F-Measure (Unseen)· Extra Data· 2020-07-16
Kernelized Memory Network for Video Object Segmentation Code
#47AFB-URR
82.6
F-Measure (Unseen)· 2020-10-15
Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement Code
#48AFB-URR
82.6
F-Measure (Unseen)· Extra Data· 2020-10-15
Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement Code
#49RMN
82.4
F-Measure (Unseen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#50RMNet
82.4
F-Measure (Unseen)· Extra Data· 2021-03-24
Efficient Regional Memory Network for Video Object Segmentation Code
#51AOT-T
82.2
F-Measure (Unseen)· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#52STM
80.9
F-Measure (Unseen)· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#53FRTMSOTA
74.1
F-Measure (Unseen)· 2020-02-27
Learning Fast and Robust Target Models for Video Object Segmentation Code
#54e-OSVOS
73.8
F-Measure (Unseen)· Extra Data· 2020-12-03
Make One-Shot Video Object Segmentation Efficient Again Code
#55MAMP
73.2
F-Measure (Unseen)· 2021-07-27
Self-Supervised Video Object Segmentation by Motion-Aware Mask Propagation Code
#56STM-cycle
70.4
F-Measure (Unseen)· 2020-10-23
Delving into the Cyclic Mechanism in Semi-supervised Video Object Segmentation Code
#57SSM-VOS
62.6
F-Measure (Unseen)
No paperCode
#58S2SSOTA
61.2
F-Measure (Unseen)· 2018-09-03
YouTube-VOS: Sequence-to-Sequence Video Object Segmentation Code
#59OSVOSSOTA
60.7
F-Measure (Unseen)· 2016-11-16
One-Shot Video Object Segmentation Code
#60CapsuleVOS
59.9
F-Measure (Unseen)· 2019-09-30
CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing Code
#61RVOS
51
F-Measure (Unseen)· 2019-03-13
RVOS: End-to-End Recurrent Network for Video Object Segmentation Code
#62S2S (offline)
50.3
F-Measure (Unseen)· 2018-09-03
YouTube-VOS: Sequence-to-Sequence Video Object Segmentation Code
#63OSMN
44
F-Measure (Unseen)· 2018-02-04
Efficient Video Object Segmentation via Network Modulation Code