Classification on RAFT

Metric: TEH (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	TEH▼	Augmentations	Paper	Date↕	Code
1	Human (crowdsourced)	0.722	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
2	T-Few	0.586	No	Few-Shot Parameter-Efficient Fine-Tuning is Bett...	2022-05-11	Code
3	GPT-Neo	0.554	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
4	BART MNLI zero-shot	0.543	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
5	GPT-3	0.526	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
6	AdaBoost	0.443	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
7	Plurality-class	0.366	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
8	GPT-2	0.311	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
9	GPT-3 zero-shot	0.303	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code

#1Human (crowdsourced)SOTA
0.722
TEH· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#2T-Few
0.586
TEH· 2022-05-11
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning Code
#3GPT-Neo
0.554
TEH· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#4BART MNLI zero-shot
0.543
TEH· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#5GPT-3
0.526
TEH· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#6AdaBoost
0.443
TEH· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#7Plurality-class
0.366
TEH· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#8GPT-2
0.311
TEH· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#9GPT-3 zero-shot
0.303
TEH· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code