TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Side4Video

Side4Video

Reported on 30 benchmarks across 2 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision30 results

  • VideoonVATEX
    text-to-video MedianR· 2023-11-27
    2.7
    SOTA
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonVATEX
    text-to-video MedianR· 2023-11-27
    2.7
    SOTA
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonMSR-VTT-1kA
    text-to-video Mean Rank· 2023-11-27
    12.8
    best: 28.2 (Collaborative Experts)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonMSR-VTT-1kA
    text-to-video Median Rank· 2023-11-27
    1
    best: 13 (JSFusion)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonMSR-VTT-1kA
    text-to-video R@1· 2023-11-27
    52.3
    best: 62.9 (HunYuan_tvr (huge))
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonMSR-VTT-1kA
    text-to-video R@10· 2023-11-27
    84.2
    best: 90.8 (HunYuan_tvr (huge))
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonMSR-VTT-1kA
    text-to-video R@5· 2023-11-27
    75.5
    best: 84.5 (HunYuan_tvr (huge))
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonVATEX
    text-to-video R@1· 2023-11-27
    68.8
    best: 87.7 (GRAM)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonVATEX
    text-to-video R@10· 2023-11-27
    97
    best: 100 (GRAM)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonVATEX
    text-to-video R@5· 2023-11-27
    93.5
    best: 98.2 (VAST)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonVATEX
    text-to-video R@50· 2023-11-27
    1
    best: 96.3 (LAFF)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonMSVD
    text-to-video Mean Rank· 2023-11-27
    8.4
    best: 23.1 (Collaborative Experts)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonMSVD
    text-to-video Median Rank· 2023-11-27
    1
    best: 6 (SSML)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonMSVD
    text-to-video R@1· 2023-11-27
    56.1
    best: 61.4 (InternVideo2-6B)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonMSVD
    text-to-video R@10· 2023-11-27
    88.8
    best: 90.3 (HunYuan_tvr (huge))
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • VideoonMSVD
    text-to-video R@5· 2023-11-27
    81.7
    best: 87.6 (CAMoE)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonMSR-VTT-1kA
    text-to-video Mean Rank· 2023-11-27
    12.8
    best: 28.2 (Collaborative Experts)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonMSR-VTT-1kA
    text-to-video Median Rank· 2023-11-27
    1
    best: 13 (JSFusion)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonMSR-VTT-1kA
    text-to-video R@1· 2023-11-27
    52.3
    best: 62.9 (HunYuan_tvr (huge))
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonMSR-VTT-1kA
    text-to-video R@10· 2023-11-27
    84.2
    best: 90.8 (HunYuan_tvr (huge))
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonMSR-VTT-1kA
    text-to-video R@5· 2023-11-27
    75.5
    best: 84.5 (HunYuan_tvr (huge))
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonVATEX
    text-to-video R@1· 2023-11-27
    68.8
    best: 87.7 (GRAM)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonVATEX
    text-to-video R@10· 2023-11-27
    97
    best: 100 (GRAM)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonVATEX
    text-to-video R@5· 2023-11-27
    93.5
    best: 98.2 (VAST)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonVATEX
    text-to-video R@50· 2023-11-27
    1
    best: 96.3 (LAFF)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonMSVD
    text-to-video Mean Rank· 2023-11-27
    8.4
    best: 23.1 (Collaborative Experts)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonMSVD
    text-to-video Median Rank· 2023-11-27
    1
    best: 6 (SSML)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonMSVD
    text-to-video R@1· 2023-11-27
    56.1
    best: 61.4 (InternVideo2-6B)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonMSVD
    text-to-video R@10· 2023-11-27
    88.8
    best: 90.3 (HunYuan_tvr (huge))
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769
  • Video RetrievalonMSVD
    text-to-video R@5· 2023-11-27
    81.7
    best: 87.6 (CAMoE)
    Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer LearningarXiv:2311.15769