Classification on RAFT

Metric: OSE (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	OSE▼	Augmentations	Paper	Date↕	Code
1	T-Few	0.676	No	Few-Shot Parameter-Efficient Fine-Tuning is Bett...	2022-05-11	Code
2	Human (crowdsourced)	0.646	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
3	AdaBoost	0.475	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
4	GPT-3	0.431	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
5	BART MNLI zero-shot	0.36	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
6	GPT-Neo	0.343	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
7	GPT-3 zero-shot	0.323	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
8	GPT-2	0.245	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
9	Plurality-class	0.164	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code

#1T-FewSOTA
0.676
OSE· 2022-05-11
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning Code
#2Human (crowdsourced)SOTA
0.646
OSE· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#3AdaBoost
0.475
OSE· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#4GPT-3
0.431
OSE· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#5BART MNLI zero-shot
0.36
OSE· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#6GPT-Neo
0.343
OSE· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#7GPT-3 zero-shot
0.323
OSE· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#8GPT-2
0.245
OSE· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#9Plurality-class
0.164
OSE· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code