Description
Soft Split and Soft Composition are video frame based operations used in the FuseFormer architecture, specifically the FuseFormer blocks. We softly split each frame into overlapped patches and then softly composite them back, by using an unfold and fold operator with patch size being greater than patch stride . When compositing patches back to its original spatial shape, we add up feature values at each overlapping spatial location of neighboring patches.