Image Classification on VTAB-1k

Metric: Top-1 Accuracy (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	Top-1 Accuracy▼	Extra Data	Paper	Date↕	Code
1	ALIGN (50 hypers/task)	79.99	Yes	Scaling Up Visual and Vision-Language Representa...	2021-02-11	Code
2	BiT-L (50 hypers/task)	78.72	Yes	Big Transfer (BiT): General Visual Representatio...	2019-12-24	Code
3	ViT-G/14	78.29	Yes	Scaling Vision Transformers	2021-06-08	Code
4	PVP(VIT-Base)	78.02	Yes	PVP: Pre-trained Visual Parameter-Efficient Tuning	2023-04-26	-
5	ExpertEnsembles R101	77.6	Yes	Deep Ensembles for Low-Data Transfer Learning	2020-10-14	-
6	BiT-L	76.3	Yes	Big Transfer (BiT): General Visual Representatio...	2019-12-24	Code
7	S4L-Exemplar-ResNet50-LargeHyperSweep	72.7	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
8	ScalableExperts (I21k+JFT)	72.3	Yes	Scalable Transfer Learning with Expert Models	2020-09-28	-
9	S4L-Rotation-ResNet50-LargeHyperSweep	71.5	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
10	ImageNet-ResNet50-LargeHyperSweep	71.2	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
11	BiT-M	70.6	Yes	Big Transfer (BiT): General Visual Representatio...	2019-12-24	Code
12	VIVI-Ex4-Co	70.4	Yes	Self-Supervised Learning of Video-Induced Visual...	2019-12-05	-
13	S4L-Rotation-ResNet50	67.5	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
14	S4L-Exemplar-ResNet50	67	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
15	BiT-S	66.9	Yes	Big Transfer (BiT): General Visual Representatio...	2019-12-24	Code
16	ImageNet-ResNet50	65.6	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
17	S4L-10%-Rotation-ResNet50	64.8	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
18	S4L-10%-Exemplar-ResNet50	63.9	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
19	ImageNet-10%-ResNet50	61.6	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
20	SelfSup-Rotation-ResNet50	59.5	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
21	ResNet50-LargeHyperSweep	59.2	No	A Large-scale Study of Representation Learning w...	2019-10-01	Code
22	BigBiGAN-ResNet50	59.1	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
23	UpperCaSE-EfficientNetB0	58.4	No	Contextual Squeeze-and-Excitation for Efficient ...	2022-06-20	Code
24	SelfSup-Exemplar-ResNet50	57.5	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
25	UpperCaSE-ResNet50	56.6	No	Contextual Squeeze-and-Excitation for Efficient ...	2022-06-20	Code
26	SelfSup-Jigsaw-ResNet50	51.1	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
27	SelfSup-RelativePatchLoc-ResNet50	50.8	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
28	Unconditional-BigGAN-ResNet50	44	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
29	ResNet50	42.1	No	A Large-scale Study of Representation Learning w...	2019-10-01	Code
30	VAE	37.5	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
31	WAE-MMD	37.3	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
32	Conditional-BigGAN	35.3	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
33	WAE-GAN	32	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code
34	WAE-UKL	31	Yes	A Large-scale Study of Representation Learning w...	2019-10-01	Code

#1ALIGN (50 hypers/task)SOTA
79.99
Top-1 Accuracy· Extra Data· 2021-02-11
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision Code
#2BiT-L (50 hypers/task)SOTA
78.72
Top-1 Accuracy· Extra Data· 2019-12-24
Big Transfer (BiT): General Visual Representation Learning Code
#3ViT-G/14
78.29
Top-1 Accuracy· Extra Data· 2021-06-08
Scaling Vision Transformers Code
#4PVP(VIT-Base)
78.02
Top-1 Accuracy· Extra Data· 2023-04-26
PVP: Pre-trained Visual Parameter-Efficient Tuning
#5ExpertEnsembles R101
77.6
Top-1 Accuracy· Extra Data· 2020-10-14
Deep Ensembles for Low-Data Transfer Learning
#6BiT-L
76.3
Top-1 Accuracy· Extra Data· 2019-12-24
Big Transfer (BiT): General Visual Representation Learning Code
#7S4L-Exemplar-ResNet50-LargeHyperSweepSOTA
72.7
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#8ScalableExperts (I21k+JFT)
72.3
Top-1 Accuracy· Extra Data· 2020-09-28
Scalable Transfer Learning with Expert Models
#9S4L-Rotation-ResNet50-LargeHyperSweep
71.5
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#10ImageNet-ResNet50-LargeHyperSweep
71.2
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#11BiT-M
70.6
Top-1 Accuracy· Extra Data· 2019-12-24
Big Transfer (BiT): General Visual Representation Learning Code
#12VIVI-Ex4-Co
70.4
Top-1 Accuracy· Extra Data· 2019-12-05
Self-Supervised Learning of Video-Induced Visual Invariances
#13S4L-Rotation-ResNet50
67.5
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#14S4L-Exemplar-ResNet50
67
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#15BiT-S
66.9
Top-1 Accuracy· Extra Data· 2019-12-24
Big Transfer (BiT): General Visual Representation Learning Code
#16ImageNet-ResNet50
65.6
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#17S4L-10%-Rotation-ResNet50
64.8
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#18S4L-10%-Exemplar-ResNet50
63.9
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#19ImageNet-10%-ResNet50
61.6
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#20SelfSup-Rotation-ResNet50
59.5
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#21ResNet50-LargeHyperSweep
59.2
Top-1 Accuracy· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#22BigBiGAN-ResNet50
59.1
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#23UpperCaSE-EfficientNetB0
58.4
Top-1 Accuracy· 2022-06-20
Contextual Squeeze-and-Excitation for Efficient Few-Shot Image Classification Code
#24SelfSup-Exemplar-ResNet50
57.5
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#25UpperCaSE-ResNet50
56.6
Top-1 Accuracy· 2022-06-20
Contextual Squeeze-and-Excitation for Efficient Few-Shot Image Classification Code
#26SelfSup-Jigsaw-ResNet50
51.1
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#27SelfSup-RelativePatchLoc-ResNet50
50.8
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#28Unconditional-BigGAN-ResNet50
44
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#29ResNet50
42.1
Top-1 Accuracy· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#30VAE
37.5
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#31WAE-MMD
37.3
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#32Conditional-BigGAN
35.3
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#33WAE-GAN
32
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code
#34WAE-UKL
31
Top-1 Accuracy· Extra Data· 2019-10-01
A Large-scale Study of Representation Learning with the Visual Task Adaptation Benchmark Code