FudanFVL

Reported on 32 benchmarks across 1 task

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing32 results

Image Captioningonnocaps near-domain
B1
84.47
best: 88.9 (GIT2, Single Model)
Image Captioningonnocaps near-domain
B2
69.66
best: 75.86 (GIT2, Single Model)
Image Captioningonnocaps near-domain
B3
51.95
best: 58.99 (PaLI)
Image Captioningonnocaps near-domain
B4
33.46
best: 39.98 (PaLI)
Image Captioningonnocaps near-domain
CIDEr
109.33
best: 125.51 (GIT2, Single Model)
Image Captioningonnocaps near-domain
METEOR
31.08
best: 33.47 (PaLI)
Image Captioningonnocaps near-domain
ROUGE-L
60.34
best: 63.99 (PaLI)
Image Captioningonnocaps near-domain
SPICE
14.79
best: 16.11 (GIT2, Single Model)
Image Captioningonnocaps entire
B1
83.9
best: 88.1 (GIT, Single Model)
Image Captioningonnocaps entire
B2
68.77
best: 74.81 (GIT, Single Model)
Image Captioningonnocaps entire
B3
50.84
best: 57.68 (GIT, Single Model)
Image Captioningonnocaps entire
B4
32.17
best: 37.71 (CoCa - Google Brain)
Image Captioningonnocaps entire
CIDEr
108.29
best: 126.8 (Lyrics)
Image Captioningonnocaps entire
METEOR
30.64
best: 32.5 (GIT, Single Model)
Image Captioningonnocaps entire
ROUGE-L
59.82
best: 63.12 (GIT, Single Model)
Image Captioningonnocaps entire
SPICE
14.72
best: 15.94 (GIT, Single Model)
Image Captioningonnocaps out-of-domain
B1
81.44
best: 86.28 (PaLI)
Image Captioningonnocaps out-of-domain
B2
64.71
best: 71.28 (GIT, Single Model)
Image Captioningonnocaps out-of-domain
B3
45.26
best: 52.66 (GIT, Single Model)
Image Captioningonnocaps out-of-domain
B4
25.31
best: 32 (PaLI)
Image Captioningonnocaps out-of-domain
CIDEr
106.55
best: 126.67 (PaLI)
Image Captioningonnocaps out-of-domain
METEOR
28.13
best: 30.99 (PaLI)
Image Captioningonnocaps out-of-domain
ROUGE-L
57.29
best: 61.35 (PaLI)
Image Captioningonnocaps out-of-domain
SPICE
14.21
best: 15.7 (GIT, Single Model)
Image Captioningonnocaps in-domain
B1
84.2
best: 88.86 (GIT2, Single Model)
Image Captioningonnocaps in-domain
B2
69.57
best: 76.1 (GIT, Single Model)
Image Captioningonnocaps in-domain
B3
52.56
best: 60.53 (GIT, Single Model)
Image Captioningonnocaps in-domain
B4
34.8
best: 41.65 (GIT, Single Model)
Image Captioningonnocaps in-domain
CIDEr
104.9
best: 149.1 (PaLI)
Image Captioningonnocaps in-domain
METEOR
31.77
best: 34.22 (PaLI)
Image Captioningonnocaps in-domain
ROUGE-L
60.52
best: 64.39 (PaLI)
Image Captioningonnocaps in-domain
SPICE
15.04
best: 16.36 (GIT2, Single Model)