Metric: ROUGE-L (higher is better)
| # | Model↕ | ROUGE-L▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | VAST | 40.8 | Yes | VAST: A Vision-Audio-Subtitle-Text Omni-Modality... | 2023-05-29 | Code |
| 2 | Audio Flamingo (Pengi trainset) | 39.4 | Yes | Audio Flamingo: A Novel Audio Language Model wit... | 2024-02-02 | Code |
| 3 | VALOR | 38.2 | Yes | VALOR: Vision-Audio-Language Omni-Perception Pre... | 2023-04-17 | Code |
| 4 | ZerAuCap | 25.4 | No | Zero-shot audio captioning with audio-language m... | 2023-11-14 | Code |