RWKV v5 Eagle 7B

Reported on 3 benchmarks across 3 tasks

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Methodology2 results

Transfer LearningonMML
Average (%)
31
best: 87 (GPT-4 o1(300b))
Multi-Task LearningonMML
Average (%)
31
best: 87 (GPT-4 o1(300b))

Natural Language Processing1 result

Common Sense ReasoningonWinoGrande
Accuracy
70.8
best: 96.1 (ST-MoE-32B 269B (fine-tuned))