TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/MagicLens (CLIP L)

MagicLens (CLIP L)

Reported on 18 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision18 results

  • Image RetrievalonFashion IQ
    (Recall@10+Recall@50)/2· 2024-03-28
    41.6
    best: 71.77 (DQU-CIR)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Image RetrievalonFashion IQ
    R@10· 2024-03-28
    30.7
    best: 49.96 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Image RetrievalonFashion IQ
    R@50· 2024-03-28
    52.5
    best: 71.17 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Image RetrievalonCIRCO
    mAP@10· 2024-03-28
    30.8
    best: 43.4 (MMRet-MLLM)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Image RetrievalonImageNet-R
    (Recall@10+Recall@50)/2· 2024-03-28
    48
    best: 52.95 (MagicLens (CoCa L))
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Image RetrievalonCIRR
    R@1· 2024-03-28
    30.1
    best: 50.43 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Image RetrievalonCIRR
    R@10· 2024-03-28
    74.4
    best: 84.7 (CoLLM (finetuned - BLIP-L/16))
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Image RetrievalonCIRR
    R@5· 2024-03-28
    61.7
    best: 81.08 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Image RetrievalonCIRR
    R@50· 2024-03-28
    92.6
    best: 96.1 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Composed Image Retrieval (CoIR)onFashion IQ
    (Recall@10+Recall@50)/2· 2024-03-28
    41.6
    best: 60.57 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Composed Image Retrieval (CoIR)onFashion IQ
    R@10· 2024-03-28
    30.7
    best: 49.96 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Composed Image Retrieval (CoIR)onFashion IQ
    R@50· 2024-03-28
    52.5
    best: 71.17 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Composed Image Retrieval (CoIR)onCIRCO
    mAP@10· 2024-03-28
    30.8
    best: 43.4 (MMRet-MLLM)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Composed Image Retrieval (CoIR)onImageNet-R
    (Recall@10+Recall@50)/2· 2024-03-28
    48
    best: 52.95 (MagicLens (CoCa L))
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Composed Image Retrieval (CoIR)onCIRR
    R@1· 2024-03-28
    30.1
    best: 50.43 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Composed Image Retrieval (CoIR)onCIRR
    R@10· 2024-03-28
    74.4
    best: 84.7 (CoLLM (finetuned - BLIP-L/16))
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Composed Image Retrieval (CoIR)onCIRR
    R@5· 2024-03-28
    61.7
    best: 81.08 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651
  • Composed Image Retrieval (CoIR)onCIRR
    R@50· 2024-03-28
    92.6
    best: 96.1 (CoVR-BLIP-2)
    MagicLens: Self-Supervised Image Retrieval with Open-Ended InstructionsarXiv:2403.19651