Video Object Segmentation on DAVIS 2016

Metric: J&F (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	J&F▼	Extra Data	Paper	Date↕	Code
1	ISVOS (BL30K, MS)	93.4	No	Look Before You Match: Instance Understanding Ma...	2022-12-13	-
2	ISVOS (BL30K, MS)	93.4	Yes	Look Before You Match: Instance Understanding Ma...	2022-12-13	-
3	XMem (BL30K, MS)	93.3	No	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
4	XMem (BL30K, MS)	93.3	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
5	SwinB-AOTv2-L (MS)	93	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
6	SwinB-AOST (L'=3, MS)	93	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
7	SwinB-DeAOT-L	92.9	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
8	XMem (MS)	92.7	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
9	BATMAN (val)	92.5	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
10	SwinB-AOTv2-L	92.4	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
11	SwinB-AOST (L'=3)	92.4	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
12	R50-DeAOT-L	92.3	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
13	R50-AOST (L'=3)	92.1	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
14	SwinB-AOT-L	92	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
15	XMem (BL30K)	92	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
16	QDMN	92	Yes	Learning Quality-aware Dynamic Memory for Video ...	2022-07-16	Code
17	R50-AOST (L'=2)	92	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
18	DeAOT-L	92	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
19	STCN + TrickVOS (PT)	91.8	No	TrickVOS: A Bag of Tricks for Video Object Segme...	2023-06-27	-
20	RAVOS	91.7	Yes	Region Aware Video Object Segmentation with Deep...	2022-07-21	-
21	STCN	91.7	Yes	Rethinking Space-Time Networks with Improved Mem...	2021-06-09	Code
22	STCN (val)	91.6	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
23	XMem	91.5	No	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
24	XMem	91.5	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
25	MobileVOS (val)	91.4	No	MobileVOS: Real-Time Video Object Segmentation C...	2023-03-14	-
26	MobileVOS (BL30K)	91.4	Yes	MobileVOS: Real-Time Video Object Segmentation C...	2023-03-14	-
27	AOT (val)	91.1	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
28	R50-AOT-L	91.1	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
29	MiVOS	91	Yes	Modular Interactive Video Object Segmentation: I...	2021-03-14	Code
30	DeAOT-B	91	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
31	HMMN	90.8	Yes	Hierarchical Memory Matching Network for Video O...	2021-09-23	Code
32	XMem (DAVIS+YouTubeVOS only)	90.8	Yes	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
33	LCM (val)	90.7	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
34	RPCMVOS (val)	90.6	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
35	MobileVOS	90.6	No	MobileVOS: Real-Time Video Object Segmentation C...	2023-03-14	-
36	RPCMVOS	90.6	No	Reliable Propagation-Correction Modulation for V...	2021-12-06	Code
37	KMN (val)	90.5	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
38	TransVOS (val)	90.5	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
39	KMN	90.5	No	Kernelized Memory Network for Video Object Segme...	2020-07-16	Code
40	AOT-L	90.4	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
41	R50-AOST (L'=1)	90.3	No	Scalable Video Object Segmentation with Identifi...	2022-03-22	Code
42	CFBI+ (val)	89.9	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
43	AOT-L	89.9	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
44	CFBI+	89.9	No	Collaborative Video Object Segmentation by Multi...	2020-10-13	Code
45	ViTAE-T-Stage	89.8	No	ViTAE: Vision Transformer Advanced by Exploring ...	2021-06-07	Code
46	CFBI (val)	89.4	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
47	STM	89.4	Yes	Video Object Segmentation using Space-Time Memor...	2019-04-01	Code
48	AOT-S	89.4	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
49	CFBI	89.4	No	Collaborative Video Object Segmentation by Foreg...	2020-03-18	Code
50	Lightweight TrickVOS (PT)	89.3	No	TrickVOS: A Bag of Tricks for Video Object Segme...	2023-06-27	-
51	DeAOT-S	89.3	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
52	DeAOT-T	88.9	No	Decoupling Features in Hierarchical Propagation ...	2022-10-18	Code
53	RMN (val)	88.8	No	BATMAN: Bilateral Attention Transformer in Motio...	2022-08-01	-
54	RMNet	88.8	Yes	Efficient Regional Memory Network for Video Obje...	2021-03-24	Code
55	MHP-VOS	88.55	No	MHP-VOS: Multiple Hypotheses Propagation for Vid...	2019-04-17	Code
56	SWEM (val)	88.1	No	SWEM: Towards Real-Time Video Object Segmentatio...	2022-08-22	Code
57	XMem (DAVIS only)	87.8	No	XMem: Long-Term Video Object Segmentation with a...	2022-07-14	Code
58	RANet+ (online learning)	87.1	No	RANet: Ranking Attention Network for Fast Video ...	2019-08-19	Code
59	e-OSVOS	86.8	Yes	Make One-Shot Video Object Segmentation Efficien...	2020-12-03	Code
60	AOT-T	86.8	No	Associating Objects with Transformers for Video ...	2021-06-04	Code
61	PReMVOS	86.75	No	PReMVOS: Proposal-generation, Refinement and Mer...	2018-07-24	Code
62	OSVOS-S	86.55	No	Video Object Segmentation Without Temporal Infor...	2017-09-18	-
63	LSMVOS	86.5	No	LSMVOS: Long-Short-Term Similarity Matching for ...	2020-09-02	Code
64	SSM-VOS	85.9	No	-	-	Code
65	OnAVOS	85.5	No	Online Adaptation of Convolutional Neural Networ...	2017-06-28	-
66	RANet	85.45	No	RANet: Ranking Attention Network for Fast Video ...	2019-08-19	Code
67	CINM	84.2	No	CNN in MRF: Video Object Segmentation via Infere...	2018-03-26	-
68	Spatiotemporal CNN	83.8	No	Spatiotemporal CNN for Video Object Segmentation	2019-04-04	Code
69	VOSwL	83.65	No	Video Object Segmentation with Language Referrin...	2018-03-21	-
70	Lucid	82.95	No	Lucid Data Dreaming for Video Object Segmentation	2017-03-28	Code
71	AGAME	81.85	No	A Generative Appearance Model for End-to-end Vid...	2018-11-28	Code
72	RGMP	81.75	No	-	-	Code
73	FRTM (val)	81.7	No	Learning Fast and Robust Target Models for Video...	2020-02-27	Code
74	FEELVOS	81.65	No	FEELVOS: Fast End-to-End Embedding Learning for ...	2019-02-25	Code
75	CRVOS	81.6	No	CRVOS: Clue Refining Network for Video Object Se...	2020-02-10	Code
76	FAVOS	80.95	No	Fast and Accurate Online Video Object Segmentati...	2018-06-06	Code
77	OSVOS	80.2	No	One-Shot Video Object Segmentation	2016-11-16	Code
78	Siam R-CNN	78.6	No	Siam R-CNN: Visual Tracking by Re-Detection	2019-11-28	Code
79	Hou et al.	77.75	No	An Efficient 3D CNN for Action/Object Segmentati...	2019-07-21	-
80	MSK	77.55	No	Learning Video Object Segmentation from Static I...	2016-12-08	Code
81	PML	77.4	No	Blazingly Fast Video Object Segmentation with Pi...	2018-04-09	-
82	SFL	76.05	No	SegFlow: Joint Learning for Video Object Segment...	2017-09-20	Code
83	OSMN	73.45	No	Efficient Video Object Segmentation via Network ...	2018-02-04	Code
84	CTN	71.4	No	-	-	-
85	SiamMask	69.75	No	Fast Online Object Tracking and Segmentation: A ...	2018-12-12	Code
86	RGMP (val)	68.8	No	Fast Video Object Segmentation With Temporal Agg...	2020-07-11	-
87	VPN	67.9	No	Video Propagation Networks	2016-12-16	-
88	PLM	66.35	No	Pixel-Level Matching for Video Object Segmentati...	2017-08-17	-
89	OFL	65.7	Yes	-	-	-
90	MuG-W	64.65	No	Learning Video Object Segmentation from Unlabele...	2020-03-10	Code
91	BVS	59.4	No	-	-	-
92	FCP	53.8	No	-	-	-

#1ISVOS (BL30K, MS)SOTA
93.4
J&F· 2022-12-13
Look Before You Match: Instance Understanding Matters in Video Object Segmentation
#2ISVOS (BL30K, MS)
93.4
J&F· Extra Data· 2022-12-13
Look Before You Match: Instance Understanding Matters in Video Object Segmentation
#3XMem (BL30K, MS)SOTA
93.3
J&F· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#4XMem (BL30K, MS)
93.3
J&F· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#5SwinB-AOTv2-L (MS)SOTA
93
J&F· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#6SwinB-AOST (L'=3, MS)
93
J&F· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#7SwinB-DeAOT-L
92.9
J&F· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#8XMem (MS)
92.7
J&F· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#9BATMAN (val)
92.5
J&F· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#10SwinB-AOTv2-L
92.4
J&F· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#11SwinB-AOST (L'=3)
92.4
J&F· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#12R50-DeAOT-L
92.3
J&F· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#13R50-AOST (L'=3)
92.1
J&F· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#14SwinB-AOT-LSOTA
92
J&F· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#15XMem (BL30K)
92
J&F· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#16QDMN
92
J&F· Extra Data· 2022-07-16
Learning Quality-aware Dynamic Memory for Video Object Segmentation Code
#17R50-AOST (L'=2)
92
J&F· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#18DeAOT-L
92
J&F· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#19STCN + TrickVOS (PT)
91.8
J&F· 2023-06-27
TrickVOS: A Bag of Tricks for Video Object Segmentation
#20RAVOS
91.7
J&F· Extra Data· 2022-07-21
Region Aware Video Object Segmentation with Deep Motion Modeling
#21STCN
91.7
J&F· Extra Data· 2021-06-09
Rethinking Space-Time Networks with Improved Memory Coverage for Efficient Video Object Segmentation Code
#22STCN (val)
91.6
J&F· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#23XMem
91.5
J&F· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#24XMem
91.5
J&F· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#25MobileVOS (val)
91.4
J&F· 2023-03-14
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation
#26MobileVOS (BL30K)
91.4
J&F· Extra Data· 2023-03-14
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation
#27AOT (val)
91.1
J&F· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#28R50-AOT-L
91.1
J&F· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#29MiVOSSOTA
91
J&F· Extra Data· 2021-03-14
Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion Code
#30DeAOT-B
91
J&F· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#31HMMN
90.8
J&F· Extra Data· 2021-09-23
Hierarchical Memory Matching Network for Video Object Segmentation Code
#32XMem (DAVIS+YouTubeVOS only)
90.8
J&F· Extra Data· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#33LCM (val)
90.7
J&F· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#34RPCMVOS (val)
90.6
J&F· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#35MobileVOS
90.6
J&F· 2023-03-14
MobileVOS: Real-Time Video Object Segmentation Contrastive Learning meets Knowledge Distillation
#36RPCMVOS
90.6
J&F· 2021-12-06
Reliable Propagation-Correction Modulation for Video Object Segmentation Code
#37KMN (val)
90.5
J&F· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#38TransVOS (val)
90.5
J&F· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#39KMNSOTA
90.5
J&F· 2020-07-16
Kernelized Memory Network for Video Object Segmentation Code
#40AOT-L
90.4
J&F· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#41R50-AOST (L'=1)
90.3
J&F· 2022-03-22
Scalable Video Object Segmentation with Identification Mechanism Code
#42CFBI+ (val)
89.9
J&F· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#43AOT-L
89.9
J&F· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#44CFBI+
89.9
J&F· 2020-10-13
Collaborative Video Object Segmentation by Multi-Scale Foreground-Background Integration Code
#45ViTAE-T-Stage
89.8
J&F· 2021-06-07
ViTAE: Vision Transformer Advanced by Exploring Intrinsic Inductive Bias Code
#46CFBI (val)
89.4
J&F· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#47STMSOTA
89.4
J&F· Extra Data· 2019-04-01
Video Object Segmentation using Space-Time Memory Networks Code
#48AOT-S
89.4
J&F· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#49CFBI
89.4
J&F· 2020-03-18
Collaborative Video Object Segmentation by Foreground-Background Integration Code
#50Lightweight TrickVOS (PT)
89.3
J&F· 2023-06-27
TrickVOS: A Bag of Tricks for Video Object Segmentation
#51DeAOT-S
89.3
J&F· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#52DeAOT-T
88.9
J&F· 2022-10-18
Decoupling Features in Hierarchical Propagation for Video Object Segmentation Code
#53RMN (val)
88.8
J&F· 2022-08-01
BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation
#54RMNet
88.8
J&F· Extra Data· 2021-03-24
Efficient Regional Memory Network for Video Object Segmentation Code
#55MHP-VOS
88.55
J&F· 2019-04-17
MHP-VOS: Multiple Hypotheses Propagation for Video Object Segmentation Code
#56SWEM (val)
88.1
J&F· 2022-08-22
SWEM: Towards Real-Time Video Object Segmentation with Sequential Weighted Expectation-Maximization Code
#57XMem (DAVIS only)
87.8
J&F· 2022-07-14
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model Code
#58RANet+ (online learning)
87.1
J&F· 2019-08-19
RANet: Ranking Attention Network for Fast Video Object Segmentation Code
#59e-OSVOS
86.8
J&F· Extra Data· 2020-12-03
Make One-Shot Video Object Segmentation Efficient Again Code
#60AOT-T
86.8
J&F· 2021-06-04
Associating Objects with Transformers for Video Object Segmentation Code
#61PReMVOSSOTA
86.75
J&F· 2018-07-24
PReMVOS: Proposal-generation, Refinement and Merging for Video Object Segmentation Code
#62OSVOS-SSOTA
86.55
J&F· 2017-09-18
Video Object Segmentation Without Temporal Information
#63LSMVOS
86.5
J&F· 2020-09-02
LSMVOS: Long-Short-Term Similarity Matching for Video Object Code
#64SSM-VOS
85.9
J&F
No paperCode
#65OnAVOSSOTA
85.5
J&F· 2017-06-28
Online Adaptation of Convolutional Neural Networks for Video Object Segmentation
#66RANet
85.45
J&F· 2019-08-19
RANet: Ranking Attention Network for Fast Video Object Segmentation Code
#67CINM
84.2
J&F· 2018-03-26
CNN in MRF: Video Object Segmentation via Inference in A CNN-Based Higher-Order Spatio-Temporal MRF
#68Spatiotemporal CNN
83.8
J&F· 2019-04-04
Spatiotemporal CNN for Video Object Segmentation Code
#69VOSwL
83.65
J&F· 2018-03-21
Video Object Segmentation with Language Referring Expressions
#70LucidSOTA
82.95
J&F· 2017-03-28
Lucid Data Dreaming for Video Object Segmentation Code
#71AGAME
81.85
J&F· 2018-11-28
A Generative Appearance Model for End-to-end Video Object Segmentation Code
#72RGMP
81.75
J&F
No paperCode
#73FRTM (val)
81.7
J&F· 2020-02-27
Learning Fast and Robust Target Models for Video Object Segmentation Code
#74FEELVOS
81.65
J&F· 2019-02-25
FEELVOS: Fast End-to-End Embedding Learning for Video Object Segmentation Code
#75CRVOS
81.6
J&F· 2020-02-10
CRVOS: Clue Refining Network for Video Object Segmentation Code
#76FAVOS
80.95
J&F· 2018-06-06
Fast and Accurate Online Video Object Segmentation via Tracking Parts Code
#77OSVOSSOTA
80.2
J&F· 2016-11-16
One-Shot Video Object Segmentation Code
#78Siam R-CNN
78.6
J&F· 2019-11-28
Siam R-CNN: Visual Tracking by Re-Detection Code
#79Hou et al.
77.75
J&F· 2019-07-21
An Efficient 3D CNN for Action/Object Segmentation in Video
#80MSK
77.55
J&F· 2016-12-08
Learning Video Object Segmentation from Static Images Code
#81PML
77.4
J&F· 2018-04-09
Blazingly Fast Video Object Segmentation with Pixel-Wise Metric Learning
#82SFL
76.05
J&F· 2017-09-20
SegFlow: Joint Learning for Video Object Segmentation and Optical Flow Code
#83OSMN
73.45
J&F· 2018-02-04
Efficient Video Object Segmentation via Network Modulation Code
#84CTN
71.4
J&F
No paper
#85SiamMask
69.75
J&F· 2018-12-12
Fast Online Object Tracking and Segmentation: A Unifying Approach Code
#86RGMP (val)
68.8
J&F· 2020-07-11
Fast Video Object Segmentation With Temporal Aggregation Network and Dynamic Template Matching
#87VPN
67.9
J&F· 2016-12-16
Video Propagation Networks
#88PLM
66.35
J&F· 2017-08-17
Pixel-Level Matching for Video Object Segmentation using Convolutional Neural Networks
#89OFL
65.7
J&F· Extra Data
No paper
#90MuG-W
64.65
J&F· 2020-03-10
Learning Video Object Segmentation from Unlabeled Videos Code
#91BVS
59.4
J&F
No paper
#92FCP
53.8
J&F
No paper