Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/XMem (BL30K, MS)

XMem (BL30K, MS)

Reported on 67 benchmarks across 3 tasks · 1 paper · 36 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision79 results

VideoonDAVIS-2017 (test-dev)
F-measure· 2022-07-14
87
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS-2017 (test-dev)
Jaccard· 2022-07-14
80.5
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS-2017 (test-dev)
Mean Jaccard & F-Measure· 2022-07-14
83.7
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2016
J&F· 2022-07-14
93.3
best: 93.4 (ISVOS (BL30K, MS))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2016
Jaccard (Mean)· 2022-07-14
92.2
best: 92.5 (ISVOS (BL30K, MS))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2018
F-Measure (Unseen)· 2022-07-14
90.2
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2018
Jaccard (Unseen)· 2022-07-14
81.7
best: 82.2 (Cutie+ (base, MEGA))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2018
Mean Jaccard & F-Measure· 2022-07-14
86.9
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2017 (val)
F-measure (Mean)· uses extra data· 2022-07-14
92.6
best: 93.4 (Cutie+ (base))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2017 (val)
J&F· uses extra data· 2022-07-14
89.5
best: 90.7 (SAM2)
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2017 (val)
Jaccard (Mean)· uses extra data· 2022-07-14
86.3
best: 87.5 (Cutie+ (base))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2019
Overall· uses extra data· 2022-07-14
86.8
best: 87.5 (Cutie+ (base, MEGA))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2018
Overall· uses extra data· 2022-07-14
86.9
best: 87.5 (Cutie+ (base, MEGA))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS-2017 (test-dev)
F-measure· 2022-07-14
87
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS-2017 (test-dev)
Jaccard· 2022-07-14
80.5
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS-2017 (test-dev)
Mean Jaccard & F-Measure· 2022-07-14
83.7
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2016
J&F· 2022-07-14
93.3
best: 93.4 (ISVOS (BL30K, MS))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2016
Jaccard (Mean)· 2022-07-14
92.2
best: 92.5 (ISVOS (BL30K, MS))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2018
F-Measure (Unseen)· 2022-07-14
90.2
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2018
Jaccard (Unseen)· 2022-07-14
81.7
best: 82.2 (Cutie+ (base, MEGA))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2018
Mean Jaccard & F-Measure· 2022-07-14
86.9
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2017 (val)
F-measure (Mean)· uses extra data· 2022-07-14
92.6
best: 93.4 (Cutie+ (base))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2017 (val)
J&F· uses extra data· 2022-07-14
89.5
best: 90.7 (SAM2)
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2017 (val)
Jaccard (Mean)· uses extra data· 2022-07-14
86.3
best: 87.5 (Cutie+ (base))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2019
Overall· uses extra data· 2022-07-14
86.8
best: 87.5 (Cutie+ (base, MEGA))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2018
Overall· uses extra data· 2022-07-14
86.9
best: 87.5 (Cutie+ (base, MEGA))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonDAVIS 2017 (val)
F-measure (Mean)· uses extra data· 2022-07-14
92.6
best: 93.4 (Cutie+ (base))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonDAVIS 2017 (val)
J&F· uses extra data· 2022-07-14
89.5
best: 90.7 (SAM2)
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonDAVIS 2017 (val)
Jaccard (Mean)· uses extra data· 2022-07-14
86.3
best: 87.5 (Cutie+ (base))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonDAVIS 2016
J&F· uses extra data· 2022-07-14
93.3
best: 93.4 (ISVOS (BL30K, MS))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonDAVIS 2016
Jaccard (Mean)· uses extra data· 2022-07-14
92.2
best: 92.5 (ISVOS (BL30K, MS))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonYouTube-VOS 2019
F-Measure (Unseen)· uses extra data· 2022-07-14
89.9
best: 90.5 (Cutie+ (base, MEGA))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonYouTube-VOS 2019
Overall· uses extra data· 2022-07-14
86.8
best: 87.5 (Cutie+ (base, MEGA))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
F-Measure (Unseen)· uses extra data· 2022-07-14
90.2
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
Jaccard (Unseen)· uses extra data· 2022-07-14
81.7
best: 82.2 (Cutie+ (base, MEGA))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
Overall· uses extra data· 2022-07-14
86.9
best: 87.5 (Cutie+ (base, MEGA))
SOTA
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2016
F-Score· 2022-07-14
94.4
best: 94.7 (AOC-MF (val))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2018
F-Measure (Seen)· 2022-07-14
90.3
best: 91 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2018
Jaccard (Seen)· 2022-07-14
85.6
best: 86.6 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2016
F-measure (Mean)· uses extra data· 2022-07-14
94.4
best: 94.7 (SwinB-DeAOT-L)
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2016
J&F· uses extra data· 2022-07-14
93.3
best: 93.4 (ISVOS (BL30K, MS))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2016
Jaccard (Mean)· uses extra data· 2022-07-14
92.2
best: 92.5 (ISVOS (BL30K, MS))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2019
F-Measure (Seen)· uses extra data· 2022-07-14
89.8
best: 90.6 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2019
F-Measure (Unseen)· uses extra data· 2022-07-14
89.9
best: 90.5 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2019
Jaccard (Seen)· uses extra data· 2022-07-14
85.5
best: 86.3 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2019
Jaccard (Unseen)· uses extra data· 2022-07-14
81.8
best: 754.8 (R50-AOST (L'=1))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2017 (test-dev)
F-measure (Mean)· uses extra data· 2022-07-14
87
best: 91.4 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2017 (test-dev)
J&F· uses extra data· 2022-07-14
83.7
best: 88.1 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonDAVIS 2017 (test-dev)
Jaccard (Mean)· uses extra data· 2022-07-14
80.5
best: 84.7 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2018
F-Measure (Seen)· uses extra data· 2022-07-14
90.3
best: 91 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2018
F-Measure (Unseen)· uses extra data· 2022-07-14
90.2
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2018
Jaccard (Seen)· uses extra data· 2022-07-14
85.6
best: 86.6 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
VideoonYouTube-VOS 2018
Jaccard (Unseen)· uses extra data· 2022-07-14
81.7
best: 82.2 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2016
F-Score· 2022-07-14
94.4
best: 94.7 (AOC-MF (val))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2018
F-Measure (Seen)· 2022-07-14
90.3
best: 91 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2018
Jaccard (Seen)· 2022-07-14
85.6
best: 86.6 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2016
F-measure (Mean)· uses extra data· 2022-07-14
94.4
best: 94.7 (SwinB-DeAOT-L)
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2016
J&F· uses extra data· 2022-07-14
93.3
best: 93.4 (ISVOS (BL30K, MS))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2016
Jaccard (Mean)· uses extra data· 2022-07-14
92.2
best: 92.5 (ISVOS (BL30K, MS))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2019
F-Measure (Seen)· uses extra data· 2022-07-14
89.8
best: 90.6 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2019
F-Measure (Unseen)· uses extra data· 2022-07-14
89.9
best: 90.5 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2019
Jaccard (Seen)· uses extra data· 2022-07-14
85.5
best: 86.3 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2019
Jaccard (Unseen)· uses extra data· 2022-07-14
81.8
best: 754.8 (R50-AOST (L'=1))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2017 (test-dev)
F-measure (Mean)· uses extra data· 2022-07-14
87
best: 91.4 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2017 (test-dev)
J&F· uses extra data· 2022-07-14
83.7
best: 88.1 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonDAVIS 2017 (test-dev)
Jaccard (Mean)· uses extra data· 2022-07-14
80.5
best: 84.7 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2018
F-Measure (Seen)· uses extra data· 2022-07-14
90.3
best: 91 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2018
F-Measure (Unseen)· uses extra data· 2022-07-14
90.2
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2018
Jaccard (Seen)· uses extra data· 2022-07-14
85.6
best: 86.6 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Video Object SegmentationonYouTube-VOS 2018
Jaccard (Unseen)· uses extra data· 2022-07-14
81.7
best: 82.2 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonDAVIS 2016
F-measure (Mean)· uses extra data· 2022-07-14
94.4
best: 94.7 (SwinB-DeAOT-L)
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonYouTube-VOS 2019
F-Measure (Seen)· uses extra data· 2022-07-14
89.8
best: 90.6 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonYouTube-VOS 2019
Jaccard (Seen)· uses extra data· 2022-07-14
85.5
best: 86.3 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonYouTube-VOS 2019
Jaccard (Unseen)· uses extra data· 2022-07-14
81.8
best: 754.8 (R50-AOST (L'=1))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonDAVIS 2017 (test-dev)
F-measure (Mean)· uses extra data· 2022-07-14
87
best: 91.4 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonDAVIS 2017 (test-dev)
J&F· uses extra data· 2022-07-14
83.7
best: 88.1 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonDAVIS 2017 (test-dev)
Jaccard (Mean)· uses extra data· 2022-07-14
80.5
best: 84.7 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
F-Measure (Seen)· uses extra data· 2022-07-14
90.3
best: 91 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
Jaccard (Seen)· uses extra data· 2022-07-14
85.6
best: 86.6 (Cutie+ (base, MEGA))
XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model arXiv:2207.07115