LLaMA3 8B+MoSLoRA

Reported on 2 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Question AnsweringonPIQA
Accuracy· 2024-06-16
89.7
best: 90.1 (Unicorn 11B (fine-tuned))
Mixture-of-Subspaces in Low-Rank Adaptation arXiv:2406.11909
Common Sense ReasoningonWinoGrande
Accuracy· 2024-06-16
85.8
best: 96.1 (ST-MoE-32B 269B (fine-tuned))
Mixture-of-Subspaces in Low-Rank Adaptation arXiv:2406.11909