AutoML on CIFAR-10

Metric: Search Time (GPU days) (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide augmentations

Sort:

#	Model↕	Search Time (GPU days)▼	Augmentations	Paper	Date↕	Code
1	AlphaX-1 (cutout NASNet)	224	No	AlphaX: eXploring Neural Architectures with Deep...	2019-03-26	Code
2	NAO	200	No	-	-	-
3	arch2vec	10.5	No	Does Unsupervised Architecture Representation Le...	2020-06-12	Code
4	CATE	10.3	No	CATE: Computation-aware Neural Architecture Enco...	2021-02-14	Code
5	FairNAS-A	8	Yes	FairNAS: Rethinking Evaluation Fairness of Weigh...	2019-07-03	Code
6	DARTS (second order)	4	No	DARTS: Differentiable Architecture Search	2018-06-24	Code
7	sharpDARTS	1.8	No	sharpDARTS: Faster and More Accurate Differentia...	2019-03-23	Code
8	SETN (T=1K) + CutOut	1.8	No	One-Shot Neural Architecture Search via Self-Eva...	2019-10-13	Code
9	DARTS (first order)	1.5	No	DARTS: Differentiable Architecture Search	2018-06-24	Code
10	NAT-M4	1	Yes	Neural Architecture Transfer	2020-05-12	Code
11	NAT-M3	1	Yes	Neural Architecture Transfer	2020-05-12	Code
12	NAT-M2	1	Yes	Neural Architecture Transfer	2020-05-12	Code
13	NAT-M1	1	No	Neural Architecture Transfer	2020-05-12	Code
14	NASGEP	1	No	Optimizing Neural Architecture Search using Limi...	2020-05-15	Code
15	SharpSepConvDARTS	0.8	No	sharpDARTS: Faster and More Accurate Differentia...	2019-03-23	Code
16	Soft Parameter Sharing	0.7	No	Learning Implicitly Recurrent CNNs Through Param...	2019-02-26	Code
17	DARTS-PRIME	0.5	No	DARTS-PRIME: Regularization and Scheduling Impro...	2021-06-22	-
18	iDARTS +ME	0.4	No	iDARTS: Improving DARTS by Node Normalization an...	2021-08-25	-
19	DU-DARTS	0.4	No	-	-	Code
20	TNASP	0.3	No	-	-	-
21	MSR-DARTS	0.3	No	MSR-DARTS: Minimum Stable Rank of Differentiable...	2020-09-19	-
22	NoisyDARTS	0.25	No	Noisy Differentiable Architecture Search	2020-05-07	Code
23	SGAS	0.25	No	SGAS: Sequential Greedy Architecture Search	2019-11-30	Code
24	FairDARTS-a	0.25	No	Fair DARTS: Eliminating Unfair Advantages in Dif...	2019-11-27	Code
25	GDAS	0.21	No	Searching for A Robust Neural Architecture in Fo...	2019-10-10	Code
26	GDAS (FRC)	0.17	No	Searching for A Robust Neural Architecture in Fo...	2019-10-10	Code
27	PC-DARTS	0.1	No	PC-DARTS: Partial Channel Connections for Memory...	2019-07-12	Code
28	μDARTS	0.1	No	$μ$DARTS: Model Uncertainty-Aware Differentiable...	2021-07-24	-
29	Bonsai-Net	0.1	No	Bonsai-Net: One-Shot Neural Architecture Search ...	2020-06-12	Code
30	NN-MASS- CIFAR-A	0	No	-	-	Code
31	NN-MASS- CIFAR-C	0	No	-	-	Code

#1AlphaX-1 (cutout NASNet)SOTA
224
Search Time (GPU days)· 2019-03-26
AlphaX: eXploring Neural Architectures with Deep Neural Networks and Monte Carlo Tree Search Code
#2NAO
200
Search Time (GPU days)
No paper
#3arch2vec
10.5
Search Time (GPU days)· 2020-06-12
Does Unsupervised Architecture Representation Learning Help Neural Architecture Search?Code
#4CATE
10.3
Search Time (GPU days)· 2021-02-14
CATE: Computation-aware Neural Architecture Encoding with Transformers Code
#5FairNAS-A
8
Search Time (GPU days)· Augmentations· 2019-07-03
FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search Code
#6DARTS (second order)SOTA
4
Search Time (GPU days)· 2018-06-24
DARTS: Differentiable Architecture Search Code
#7sharpDARTS
1.8
Search Time (GPU days)· 2019-03-23
sharpDARTS: Faster and More Accurate Differentiable Architecture Search Code
#8SETN (T=1K) + CutOut
1.8
Search Time (GPU days)· 2019-10-13
One-Shot Neural Architecture Search via Self-Evaluated Template Network Code
#9DARTS (first order)
1.5
Search Time (GPU days)· 2018-06-24
DARTS: Differentiable Architecture Search Code
#10NAT-M4
1
Search Time (GPU days)· Augmentations· 2020-05-12
Neural Architecture Transfer Code
#11NAT-M3
1
Search Time (GPU days)· Augmentations· 2020-05-12
Neural Architecture Transfer Code
#12NAT-M2
1
Search Time (GPU days)· Augmentations· 2020-05-12
Neural Architecture Transfer Code
#13NAT-M1
1
Search Time (GPU days)· 2020-05-12
Neural Architecture Transfer Code
#14NASGEP
1
Search Time (GPU days)· 2020-05-15
Optimizing Neural Architecture Search using Limited GPU Time in a Dynamic Search Space: A Gene Expression Programming Approach Code
#15SharpSepConvDARTS
0.8
Search Time (GPU days)· 2019-03-23
sharpDARTS: Faster and More Accurate Differentiable Architecture Search Code
#16Soft Parameter Sharing
0.7
Search Time (GPU days)· 2019-02-26
Learning Implicitly Recurrent CNNs Through Parameter Sharing Code
#17DARTS-PRIME
0.5
Search Time (GPU days)· 2021-06-22
DARTS-PRIME: Regularization and Scheduling Improve Constrained Optimization in Differentiable NAS
#18iDARTS +ME
0.4
Search Time (GPU days)· 2021-08-25
iDARTS: Improving DARTS by Node Normalization and Decorrelation Discretization
#19DU-DARTS
0.4
Search Time (GPU days)
No paperCode
#20TNASP
0.3
Search Time (GPU days)
No paper
#21MSR-DARTS
0.3
Search Time (GPU days)· 2020-09-19
MSR-DARTS: Minimum Stable Rank of Differentiable Architecture Search
#22NoisyDARTS
0.25
Search Time (GPU days)· 2020-05-07
Noisy Differentiable Architecture Search Code
#23SGAS
0.25
Search Time (GPU days)· 2019-11-30
SGAS: Sequential Greedy Architecture Search Code
#24FairDARTS-a
0.25
Search Time (GPU days)· 2019-11-27
Fair DARTS: Eliminating Unfair Advantages in Differentiable Architecture Search Code
#25GDAS
0.21
Search Time (GPU days)· 2019-10-10
Searching for A Robust Neural Architecture in Four GPU Hours Code
#26GDAS (FRC)
0.17
Search Time (GPU days)· 2019-10-10
Searching for A Robust Neural Architecture in Four GPU Hours Code
#27PC-DARTS
0.1
Search Time (GPU days)· 2019-07-12
PC-DARTS: Partial Channel Connections for Memory-Efficient Architecture Search Code
#28μDARTS
0.1
Search Time (GPU days)· 2021-07-24
$μ$DARTS: Model Uncertainty-Aware Differentiable Architecture Search
#29Bonsai-Net
0.1
Search Time (GPU days)· 2020-06-12
Bonsai-Net: One-Shot Neural Architecture Search via Differentiable Pruners Code
#30NN-MASS- CIFAR-A
0
Search Time (GPU days)
No paperCode
#31NN-MASS- CIFAR-C
0
Search Time (GPU days)
No paperCode