Few-Shot Learning on MedConceptsQA

Metric: Accuracy (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Accuracy▼	Augmentations	Paper	Date↕	Code
1	gpt-4-0125-preview	61.911	No	GPT-4 Technical Report	2023-03-15	Code
2	gpt-3.5-turbo	41.476	No	Language Models are Few-Shot Learners	2020-05-28	Code
3	meta-llama/Meta-Llama-3-8B-Instruct	25.653	No	LLaMA: Open and Efficient Foundation Language Mo...	2023-02-27	Code
4	johnsnowlabs/JSL-MedMNX-7B	25.627	No	MedConceptsQA: Open Source Medical Concepts QA B...	2024-05-12	Code
5	yikuan8/Clinical-Longformer	25.547	No	Clinical-Longformer and Clinical-BigBird: Transf...	2022-01-27	Code
6	dmis-lab/biobert-v1.1	25.458	No	BioBERT: a pre-trained biomedical language repre...	2019-01-25	Code
7	epfl-llm/meditron-70b	25.262	No	MEDITRON-70B: Scaling Medical Pretraining for La...	2023-11-27	Code
8	BioMistral/BioMistral-7B-DARE	25.058	No	BioMistral: A Collection of Open-Source Pretrain...	2024-02-15	Code
9	HuggingFaceH4/zephyr-7b-beta	25.058	No	Zephyr: Direct Distillation of LM Alignment	2023-10-25	Code
10	dmis-lab/meerkat-7b-v1.0	24.942	No	Small Language Models Learn Enhanced Reasoning S...	2024-03-30	-
11	PharMolix/BioMedGPT-LM-7B	24.924	No	BioMedGPT: Open Multimodal Generative Pre-traine...	2023-08-18	Code
12	epfl-llm/meditron-7b	23.787	No	MEDITRON-70B: Scaling Medical Pretraining for La...	2023-11-27	Code

#1gpt-4-0125-previewSOTA
61.911
Accuracy· 2023-03-15
GPT-4 Technical Report Code
#2gpt-3.5-turboSOTA
41.476
Accuracy· 2020-05-28
Language Models are Few-Shot Learners Code
#3meta-llama/Meta-Llama-3-8B-Instruct
25.653
Accuracy· 2023-02-27
LLaMA: Open and Efficient Foundation Language Models Code
#4johnsnowlabs/JSL-MedMNX-7B
25.627
Accuracy· 2024-05-12
MedConceptsQA: Open Source Medical Concepts QA Benchmark Code
#5yikuan8/Clinical-Longformer
25.547
Accuracy· 2022-01-27
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences Code
#6dmis-lab/biobert-v1.1SOTA
25.458
Accuracy· 2019-01-25
BioBERT: a pre-trained biomedical language representation model for biomedical text mining Code
#7epfl-llm/meditron-70b
25.262
Accuracy· 2023-11-27
MEDITRON-70B: Scaling Medical Pretraining for Large Language Models Code
#8BioMistral/BioMistral-7B-DARE
25.058
Accuracy· 2024-02-15
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains Code
#9HuggingFaceH4/zephyr-7b-beta
25.058
Accuracy· 2023-10-25
Zephyr: Direct Distillation of LM Alignment Code
#10dmis-lab/meerkat-7b-v1.0
24.942
Accuracy· 2024-03-30
Small Language Models Learn Enhanced Reasoning Skills from Medical Textbooks
#11PharMolix/BioMedGPT-LM-7B
24.924
Accuracy· 2023-08-18
BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine Code
#12epfl-llm/meditron-7b
23.787
Accuracy· 2023-11-27
MEDITRON-70B: Scaling Medical Pretraining for Large Language Models Code