MedMobile (3.8B)

Reported on 2 benchmarks across 1 task · 1 paper · 1 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Question AnsweringonMedMCQA Dev
Accuarcy· 2024-10-11
63.2
SOTA
MedMobile: A mobile-sized language model with expert-level clinical capabilities arXiv:2410.09019
Question AnsweringonMedQA
Accuracy· uses extra data· 2024-10-11
75.7
best: 91.1 (Med-Gemini)
MedMobile: A mobile-sized language model with expert-level clinical capabilities arXiv:2410.09019