Text Classification on RAFT

Metric: SRI (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	SRI▼	Extra Data	Paper	Date↕	Code
1	GPT-3	0.516	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
2	T-Few	0.508	No	Few-Shot Parameter-Efficient Fine-Tuning is Bett...	2022-05-11	Code
3	AdaBoost	0.506	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
4	GPT-Neo	0.493	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
5	Plurality-class	0.493	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
6	GPT-2	0.492	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
7	Human (crowdsourced)	0.468	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
8	GPT-3 zero-shot	0.027	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code
9	BART MNLI zero-shot	0.026	No	RAFT: A Real-World Few-Shot Text Classification ...	2021-09-28	Code

#1GPT-3SOTA
0.516
SRI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#2T-Few
0.508
SRI· 2022-05-11
Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning Code
#3AdaBoost
0.506
SRI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#4GPT-Neo
0.493
SRI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#5Plurality-class
0.493
SRI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#6GPT-2
0.492
SRI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#7Human (crowdsourced)
0.468
SRI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#8GPT-3 zero-shot
0.027
SRI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code
#9BART MNLI zero-shot
0.026
SRI· 2021-09-28
RAFT: A Real-World Few-Shot Text Classification Benchmark Code