Zero-Shot Learning on MedConceptsQA

Metric: Accuracy (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Accuracy▼	Augmentations	Paper	Date↕	Code
1	gpt-4-0125-preview	52.489	No	GPT-4 Technical Report	2023-03-15	Code
2	gpt-3.5-turbo	37.058	No	Language Models are Few-Shot Learners	2020-05-28	Code
3	dmis-lab/biobert-v1.1	26.151	No	BioBERT: a pre-trained biomedical language repre...	2019-01-25	Code
4	meta-llama/Meta-Llama-3-8B-Instruct	25.84	No	LLaMA: Open and Efficient Foundation Language Mo...	2023-02-27	Code
5	epfl-llm/meditron-7b	25.751	No	MEDITRON-70B: Scaling Medical Pretraining for La...	2023-11-27	Code
6	dmis-lab/meerkat-7b-v1.0	25.68	No	Small Language Models Learn Enhanced Reasoning S...	2024-03-30	-
7	HuggingFaceH4/zephyr-7b-beta	25.538	No	Zephyr: Direct Distillation of LM Alignment	2023-10-25	Code
8	epfl-llm/meditron-70b	25.36	No	MEDITRON-70B: Scaling Medical Pretraining for La...	2023-11-27	Code
9	yikuan8/Clinical-Longformer	25.04	No	Clinical-Longformer and Clinical-BigBird: Transf...	2022-01-27	Code
10	UFNLP/gatortron-medium	24.862	No	GatorTron: A Large Clinical Language Model to Un...	2022-02-02	-
11	PharMolix/BioMedGPT-LM-7B	24.747	No	BioMedGPT: Open Multimodal Generative Pre-traine...	2023-08-18	Code
12	BioMistral/BioMistral-7B-DARE	24.569	No	BioMistral: A Collection of Open-Source Pretrain...	2024-02-15	Code
13	johnsnowlabs/JSL-MedMNX-7B	24.427	No	-	-	-

#1gpt-4-0125-previewSOTA
52.489
Accuracy· 2023-03-15
GPT-4 Technical Report Code
#2gpt-3.5-turboSOTA
37.058
Accuracy· 2020-05-28
Language Models are Few-Shot Learners Code
#3dmis-lab/biobert-v1.1SOTA
26.151
Accuracy· 2019-01-25
BioBERT: a pre-trained biomedical language representation model for biomedical text mining Code
#4meta-llama/Meta-Llama-3-8B-Instruct
25.84
Accuracy· 2023-02-27
LLaMA: Open and Efficient Foundation Language Models Code
#5epfl-llm/meditron-7b
25.751
Accuracy· 2023-11-27
MEDITRON-70B: Scaling Medical Pretraining for Large Language Models Code
#6dmis-lab/meerkat-7b-v1.0
25.68
Accuracy· 2024-03-30
Small Language Models Learn Enhanced Reasoning Skills from Medical Textbooks
#7HuggingFaceH4/zephyr-7b-beta
25.538
Accuracy· 2023-10-25
Zephyr: Direct Distillation of LM Alignment Code
#8epfl-llm/meditron-70b
25.36
Accuracy· 2023-11-27
MEDITRON-70B: Scaling Medical Pretraining for Large Language Models Code
#9yikuan8/Clinical-Longformer
25.04
Accuracy· 2022-01-27
Clinical-Longformer and Clinical-BigBird: Transformers for long clinical sequences Code
#10UFNLP/gatortron-medium
24.862
Accuracy· 2022-02-02
GatorTron: A Large Clinical Language Model to Unlock Patient Information from Unstructured Electronic Health Records
#11PharMolix/BioMedGPT-LM-7B
24.747
Accuracy· 2023-08-18
BioMedGPT: Open Multimodal Generative Pre-trained Transformer for BioMedicine Code
#12BioMistral/BioMistral-7B-DARE
24.569
Accuracy· 2024-02-15
BioMistral: A Collection of Open-Source Pretrained Large Language Models for Medical Domains Code
#13johnsnowlabs/JSL-MedMNX-7B
24.427
Accuracy
No paper