Classification on RAFT

Metric: TAI (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	TAI▼	Augmentations	Paper	Date↕	Code
1	T-Few	0.736	No	Few-Shot Parameter-Efficient Fine-Tuning is Bett...	2022-05-11	Code
2	GPT-3	0.656	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
3	GPT-2	0.612	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
4	Human (crowdsourced)	0.609	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
5	GPT-Neo	0.605	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
6	AdaBoost	0.556	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
7	BART MNLI zero-shot	0.469	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
8	GPT-3 zero-shot	0.362	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
9	Plurality-class	0.344	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code

#1T-FewSOTA
0.736
TAI· 2022-05-11
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning Code
#2GPT-3SOTA
0.656
TAI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#3GPT-2
0.612
TAI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#4Human (crowdsourced)
0.609
TAI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#5GPT-Neo
0.605
TAI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#6AdaBoost
0.556
TAI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#7BART MNLI zero-shot
0.469
TAI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#8GPT-3 zero-shot
0.362
TAI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#9Plurality-class
0.344
TAI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code