TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/LLMEPET

LLMEPET

Reported on 23 benchmarks across 6 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision20 results

  • VideoonQVHighlights
    R@1,IoU=0.5· 2024-07-21
    66.73
    best: 71.42 (InternVideo2-6B)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • VideoonQVHighlights
    R@1,IoU=0.7· 2024-07-21
    49.94
    best: 56.45 (InternVideo2-6B)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • VideoonTACoS
    R@1,IoU=0.3· 2024-07-21
    52.73
    best: 58.1 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • VideoonTACoS
    R@1,IoU=0.5· 2024-07-21
    40.12
    best: 46.79 (DeCafNet)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • VideoonTACoS
    R@1,IoU=0.7· 2024-07-21
    22.78
    best: 33.9 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • VideoonTACoS
    mIoU· 2024-07-21
    36.55
    best: 42.4 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Video RetrievalonQVHighlights
    R@1,IoU=0.5· 2024-07-21
    66.73
    best: 71.42 (InternVideo2-6B)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Video RetrievalonQVHighlights
    R@1,IoU=0.7· 2024-07-21
    49.94
    best: 56.45 (InternVideo2-6B)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Moment RetrievalonCharades-STA
    R@1 IoU=0.5· 2024-07-21
    58.31
    best: 71.1 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Moment RetrievalonCharades-STA
    R@1 IoU=0.7· 2024-07-21
    36.49
    best: 52.8 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Moment RetrievalonQVHighlights
    R@1 IoU=0.5· 2024-07-21
    66.73
    best: 76.59 (LLaVA-MR)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Moment RetrievalonQVHighlights
    R@1 IoU=0.7· 2024-07-21
    49.94
    best: 61.48 (LLaVA-MR)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Moment RetrievalonQVHighlights
    mAP· 2024-07-21
    44.05
    best: 58.8 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Moment RetrievalonQVHighlights
    mAP@0.5· 2024-07-21
    65.76
    best: 76.2 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Moment RetrievalonQVHighlights
    mAP@0.75· 2024-07-21
    43.91
    best: 60.8 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Highlight DetectiononYouTube Highlights
    mAP· 2024-07-21
    75.3
    best: 78 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Highlight DetectiononQVHighlights
    Hit@1· 2024-07-21
    65.69
    best: 71.01 (FlashVTG)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Highlight DetectiononQVHighlights
    mAP· 2024-07-21
    40.33
    best: 44.7 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Video GroundingonQVHighlights
    R@1,IoU=0.5· 2024-07-21
    66.73
    best: 71.42 (InternVideo2-6B)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • Video GroundingonQVHighlights
    R@1,IoU=0.7· 2024-07-21
    49.94
    best: 56.45 (InternVideo2-6B)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051

Methodology3 results

  • 16konYouTube Highlights
    mAP· 2024-07-21
    75.3
    best: 78 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • 16konQVHighlights
    Hit@1· 2024-07-21
    65.69
    best: 71.01 (FlashVTG)
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051
  • 16konQVHighlights
    mAP· 2024-07-21
    40.33
    best: 44.7 (SG-DETR (w/ PT))
    Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment RetrievalarXiv:2407.15051