Video Object Segmentation on YouTube-VOS 2018

Metric: Overall (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	Overall▼	Extra Data	Paper	Date↕	Code
1	Cutie+ (base, MEGA)	87.5	Yes	Putting the Object Back into Video Object Segmen...	2023-10-19	Code
2	XMem (BL30K, MS)	86.9	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
3	XMem (MS)	86.7	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
4	SwinB-AOTv2-L (all frames, MS)	86.5	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
5	SwinB-DeAOT-L	86.2	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
6	XMem (BL30K)	86.1	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
7	R50-DeAOT-L	86	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
8	SwinB-AOTv2-L (all frames)	85.8	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
9	XMem	85.7	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
10	R50-AOT-L (all frames)	85.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
11	R50-AOTv2-L (all frames)	85.4	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
12	SwinB-AOT-L (all frames)	85.1	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
13	R50-AOST (L'=3)	85	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
14	DeAOT-L	84.8	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
15	DeAOT-B	84.6	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
16	SwinB-AOT-L	84.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
17	AOT-L (all frames)	84.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
18	R50-AOST (L'=2)	84.5	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
19	XMem (YouTubeVOS only)	84.4	No	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
20	RAVOS	84.4	Yes	Region Aware Video Object Segmentation with Deep...	2022-07-21	-
21	RPCMVOS-MS	84.3	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
22	R50-AOT-L	84.1	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
23	AOT-B (all frames)	84.1	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
24	DeAOT-S	84	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
25	RPCMVOS	84	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
26	AOT-L	83.8	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
27	QDMN	83.8	Yes	Learning Quality-aware Dynamic Memory for Video ...	2022-07-16	Code
28	AOT-B	83.5	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
29	AOT-S (all frames)	83	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
30	CFBI+	82.8	No	Collaborative Video Object Segmentation by Multi...	2020-10-13	Code
31	HMMN	82.6	Yes	Hierarchical Memory Matching Network for Video O...	2021-09-23	Code
32	AOT-S	82.6	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
33	DeAOT-T	82	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
34	MiVOS	82	Yes	Modular Interactive Video Object Segmentation: I...	2021-03-14	Code
35	R50-AOST (L'=1)	81.6	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
36	RMNet	81.5	Yes	Efficient Regional Memory Network for Video Obje...	2021-03-24	Code
37	KMN	81.4	Yes	Kernelized Memory Network for Video Object Segme...	2020-07-16	Code
38	CFBI	81.4	No	Collaborative Video Object Segmentation by Foreg...	2020-03-18	Code
39	AOT-T (all frames)	80.9	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
40	AOT-T	80.2	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
41	AFB-URR	79.6	Yes	Video Object Segmentation with Adaptive Feature ...	2020-10-15	Code
42	FRTM	72.1	No	Learning Fast and Robust Target Models for Video...	2020-02-27	Code
43	e-OSVOS	71.4	Yes	Make One-Shot Video Object Segmentation Efficien...	2020-12-03	Code
44	STM-cycle	69.9	No	Delving into the Cyclic Mechanism in Semi-superv...	2020-10-23	Code
45	MAMP	68.2	No	Self-Supervised Video Object Segmentation by Mot...	2021-07-27	Code
46	STM	68.2	No	Video Object Segmentation using Space-Time Memor...	2019-04-01	Code
47	SSM-VOS	66.5	No	-	-	Code
48	S2S	64.4	No	YouTube-VOS: Sequence-to-Sequence Video Object S...	2018-09-03	Code
49	CapsuleVOS	62.3	No	CapsuleVOS: Semi-Supervised Video Object Segment...	2019-09-30	Code
50	OSVOS	58.8	No	One-Shot Video Object Segmentation	2016-11-16	Code
51	RVOS	56.8	No	RVOS: End-to-End Recurrent Network for Video Obj...	2019-03-13	Code
52	OSMN	51.2	No	Efficient Video Object Segmentation via Network ...	2018-02-04	Code

#1Cutie+ (base, MEGA)SOTA
87.5
Overall· Extra Data· 2023-10-19
Putting the Object Back into Video Object Segmentation Code
#2XMem (BL30K, MS)SOTA
86.9
Overall· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#3XMem (MS)
86.7
Overall· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#4SwinB-AOTv2-L (all frames, MS)SOTA
86.5
Overall· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#5SwinB-DeAOT-L
86.2
Overall· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#6XMem (BL30K)
86.1
Overall· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#7R50-DeAOT-L
86
Overall· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#8SwinB-AOTv2-L (all frames)
85.8
Overall· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#9XMem
85.7
Overall· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#10R50-AOT-L (all frames)SOTA
85.5
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#11R50-AOTv2-L (all frames)
85.4
Overall· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#12SwinB-AOT-L (all frames)
85.1
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#13R50-AOST (L'=3)
85
Overall· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#14DeAOT-L
84.8
Overall· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#15DeAOT-B
84.6
Overall· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#16SwinB-AOT-L
84.5
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#17AOT-L (all frames)
84.5
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#18R50-AOST (L'=2)
84.5
Overall· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#19XMem (YouTubeVOS only)
84.4
Overall· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#20RAVOS
84.4
Overall· Extra Data· 2022-07-21
Region Aware Video Object Segmentation with Deep Motion Modeling
#21RPCMVOS-MS
84.3
Overall· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#22R50-AOT-L
84.1
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#23AOT-B (all frames)
84.1
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#24DeAOT-S
84
Overall· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#25RPCMVOS
84
Overall· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#26AOT-L
83.8
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#27QDMN
83.8
Overall· Extra Data· 2022-07-16
Learning Quality-aware Dynamic Memory for Video Object Segmentation Code
#28AOT-B
83.5
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#29AOT-S (all frames)
83
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#30CFBI+SOTA
82.8
Overall· 2020-10-13
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration Code
#31HMMN
82.6
Overall· Extra Data· 2021-09-23
Hierarchical Memory Matching Network for Video Object Segmentation Code
#32AOT-S
82.6
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#33DeAOT-T
82
Overall· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#34MiVOS
82
Overall· Extra Data· 2021-03-14
Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion Code
#35R50-AOST (L'=1)
81.6
Overall· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#36RMNet
81.5
Overall· Extra Data· 2021-03-24
Efficient Regional Memory Network for Video Object Segmentation Code
#37KMN
81.4
Overall· Extra Data· 2020-07-16
Kernelized Memory Network for Video Object Segmentation Code
#38CFBISOTA
81.4
Overall· 2020-03-18
Collaborative Video Object Segmentation by Foreground-Background Integration Code
#39AOT-T (all frames)
80.9
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#40AOT-T
80.2
Overall· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#41AFB-URR
79.6
Overall· Extra Data· 2020-10-15
Video Object Segmentation with Adaptive Feature Bank and Uncertain-Region Refinement Code
#42FRTMSOTA
72.1
Overall· 2020-02-27
Learning Fast and Robust Target Models for Video Object Segmentation Code
#43e-OSVOS
71.4
Overall· Extra Data· 2020-12-03
Make One-Shot Video Object Segmentation Efficient Again Code
#44STM-cycle
69.9
Overall· 2020-10-23
Delving into the Cyclic Mechanism in Semi-supervised Video Object Segmentation Code
#45MAMP
68.2
Overall· 2021-07-27
Self-Supervised Video Object Segmentation by Motion-Aware Mask Propagation Code
#46STMSOTA
68.2
Overall· 2019-04-01
Video Object Segmentation using Space-Time Memory Networks Code
#47SSM-VOS
66.5
Overall
No paperCode
#48S2SSOTA
64.4
Overall· 2018-09-03
YouTube-VOS: Sequence-to-Sequence Video Object Segmentation Code
#49CapsuleVOS
62.3
Overall· 2019-09-30
CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing Code
#50OSVOSSOTA
58.8
Overall· 2016-11-16
One-Shot Video Object Segmentation Code
#51RVOS
56.8
Overall· 2019-03-13
RVOS: End-to-End Recurrent Network for Video Object Segmentation Code
#52OSMN
51.2
Overall· 2018-02-04
Efficient Video Object Segmentation via Network Modulation Code