Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/AOT-S

AOT-S

Reported on 78 benchmarks across 3 tasks · 1 paper · 12 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision78 results

VideoonDAVIS (no YouTube-VOS training)
D17 val (F)· 2021-06-04
82
best: 83.1 (HMMN)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS (no YouTube-VOS training)
D17 val (G)· 2021-06-04
79.2
best: 80.4 (HMMN)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS (no YouTube-VOS training)
D17 val (J)· 2021-06-04
76.4
best: 77.7 (HMMN)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS (no YouTube-VOS training)
FPS· 2021-06-04
40
best: 50.1 (TBD)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS (no YouTube-VOS training)
D17 val (F)· 2021-06-04
82
best: 83.1 (HMMN)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS (no YouTube-VOS training)
D17 val (G)· 2021-06-04
79.2
best: 80.4 (HMMN)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS (no YouTube-VOS training)
D17 val (J)· 2021-06-04
76.4
best: 77.7 (HMMN)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS (no YouTube-VOS training)
FPS· 2021-06-04
40
best: 50.1 (TBD)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS (no YouTube-VOS training)
D17 val (F)· 2021-06-04
82
best: 83.1 (HMMN)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS (no YouTube-VOS training)
D17 val (G)· 2021-06-04
79.2
best: 80.4 (HMMN)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS (no YouTube-VOS training)
D17 val (J)· 2021-06-04
76.4
best: 77.7 (HMMN)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS (no YouTube-VOS training)
FPS· 2021-06-04
40
best: 50.1 (TBD)
SOTA
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2017 (val)
F-measure (Mean)· 2021-06-04
83.9
best: 93.4 (Cutie+ (base))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2017 (val)
J&F· 2021-06-04
81.3
best: 90.7 (SAM2)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2017 (val)
Jaccard (Mean)· 2021-06-04
78.7
best: 87.5 (Cutie+ (base))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2017 (val)
Params(M)· 2021-06-04
7
best: 224.4 (SAM2)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2017 (val)
Speed (FPS)· 2021-06-04
40
best: 90.6 (MobileVOS (BL30K))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonVOT2020
EAO· 2021-06-04
0.512
best: 0.729 (DAM4SAM)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonVOT2020
EAO (real-time)· 2021-06-04
0.499
best: 0.571 (R50-DeAOT-L)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2016
F-measure (Mean)· 2021-06-04
90.2
best: 94.7 (SwinB-DeAOT-L)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2016
J&F· 2021-06-04
89.4
best: 93.4 (ISVOS (BL30K, MS))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2016
Jaccard (Mean)· 2021-06-04
88.6
best: 92.5 (ISVOS (BL30K, MS))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2016
Speed (FPS)· 2021-06-04
40
best: 100.1 (MobileVOS (BL30K))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2017 (test-dev)
F-measure (Mean)· 2021-06-04
77.5
best: 91.4 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2017 (test-dev)
FPS· 2021-06-04
40
best: 63.5 (DeAOT-T)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2017 (test-dev)
J&F· 2021-06-04
73.9
best: 88.1 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonDAVIS 2017 (test-dev)
Jaccard (Mean)· 2021-06-04
70.3
best: 84.7 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonYouTube-VOS 2018
F-Measure (Seen)· 2021-06-04
86.7
best: 91 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonYouTube-VOS 2018
F-Measure (Unseen)· 2021-06-04
85
best: 90.2 (XMem (BL30K, MS))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonYouTube-VOS 2018
Jaccard (Seen)· 2021-06-04
82
best: 86.6 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonYouTube-VOS 2018
Jaccard (Unseen)· 2021-06-04
76.6
best: 82.2 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonYouTube-VOS 2018
Overall· 2021-06-04
82.6
best: 87.5 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonYouTube-VOS 2018
Params(M)· 2021-06-04
7.9
best: 70.3 (SwinB-DeAOT-L)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
VideoonYouTube-VOS 2018
Speed (FPS)· 2021-06-04
27.1
best: 65.9 (FRTM)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2017 (val)
F-measure (Mean)· 2021-06-04
83.9
best: 93.4 (Cutie+ (base))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2017 (val)
J&F· 2021-06-04
81.3
best: 90.7 (SAM2)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2017 (val)
Jaccard (Mean)· 2021-06-04
78.7
best: 87.5 (Cutie+ (base))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2017 (val)
Params(M)· 2021-06-04
7
best: 224.4 (SAM2)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2017 (val)
Speed (FPS)· 2021-06-04
40
best: 90.6 (MobileVOS (BL30K))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonVOT2020
EAO· 2021-06-04
0.512
best: 0.729 (DAM4SAM)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonVOT2020
EAO (real-time)· 2021-06-04
0.499
best: 0.571 (R50-DeAOT-L)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2016
F-measure (Mean)· 2021-06-04
90.2
best: 94.7 (SwinB-DeAOT-L)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2016
J&F· 2021-06-04
89.4
best: 93.4 (ISVOS (BL30K, MS))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2016
Jaccard (Mean)· 2021-06-04
88.6
best: 92.5 (ISVOS (BL30K, MS))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2016
Speed (FPS)· 2021-06-04
40
best: 100.1 (MobileVOS (BL30K))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2017 (test-dev)
F-measure (Mean)· 2021-06-04
77.5
best: 91.4 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2017 (test-dev)
FPS· 2021-06-04
40
best: 63.5 (DeAOT-T)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2017 (test-dev)
J&F· 2021-06-04
73.9
best: 88.1 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonDAVIS 2017 (test-dev)
Jaccard (Mean)· 2021-06-04
70.3
best: 84.7 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonYouTube-VOS 2018
F-Measure (Seen)· 2021-06-04
86.7
best: 91 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonYouTube-VOS 2018
F-Measure (Unseen)· 2021-06-04
85
best: 90.2 (XMem (BL30K, MS))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonYouTube-VOS 2018
Jaccard (Seen)· 2021-06-04
82
best: 86.6 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonYouTube-VOS 2018
Jaccard (Unseen)· 2021-06-04
76.6
best: 82.2 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonYouTube-VOS 2018
Overall· 2021-06-04
82.6
best: 87.5 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonYouTube-VOS 2018
Params(M)· 2021-06-04
7.9
best: 70.3 (SwinB-DeAOT-L)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Video Object SegmentationonYouTube-VOS 2018
Speed (FPS)· 2021-06-04
27.1
best: 65.9 (FRTM)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2017 (val)
F-measure (Mean)· 2021-06-04
83.9
best: 93.4 (Cutie+ (base))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2017 (val)
J&F· 2021-06-04
81.3
best: 90.7 (SAM2)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2017 (val)
Jaccard (Mean)· 2021-06-04
78.7
best: 87.5 (Cutie+ (base))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2017 (val)
Params(M)· 2021-06-04
7
best: 224.4 (SAM2)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2017 (val)
Speed (FPS)· 2021-06-04
40
best: 90.6 (MobileVOS (BL30K))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonVOT2020
EAO· 2021-06-04
0.512
best: 0.729 (DAM4SAM)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonVOT2020
EAO (real-time)· 2021-06-04
0.499
best: 0.571 (R50-DeAOT-L)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2016
F-measure (Mean)· 2021-06-04
90.2
best: 94.7 (SwinB-DeAOT-L)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2016
J&F· 2021-06-04
89.4
best: 93.4 (ISVOS (BL30K, MS))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2016
Jaccard (Mean)· 2021-06-04
88.6
best: 92.5 (ISVOS (BL30K, MS))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2016
Speed (FPS)· 2021-06-04
40
best: 100.1 (MobileVOS (BL30K))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2017 (test-dev)
F-measure (Mean)· 2021-06-04
77.5
best: 91.4 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2017 (test-dev)
FPS· 2021-06-04
40
best: 63.5 (DeAOT-T)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2017 (test-dev)
J&F· 2021-06-04
73.9
best: 88.1 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonDAVIS 2017 (test-dev)
Jaccard (Mean)· 2021-06-04
70.3
best: 84.7 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
F-Measure (Seen)· 2021-06-04
86.7
best: 91 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
F-Measure (Unseen)· 2021-06-04
85
best: 90.2 (XMem (BL30K, MS))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
Jaccard (Seen)· 2021-06-04
82
best: 86.6 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
Jaccard (Unseen)· 2021-06-04
76.6
best: 82.2 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
Overall· 2021-06-04
82.6
best: 87.5 (Cutie+ (base, MEGA))
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
Params(M)· 2021-06-04
7.9
best: 70.3 (SwinB-DeAOT-L)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638
Semi-Supervised Video Object SegmentationonYouTube-VOS 2018
Speed (FPS)· 2021-06-04
27.1
best: 65.9 (FRTM)
Associating Objects with Transformers for Video Object Segmentation arXiv:2106.02638