AutoML on NAS-Bench-201, ImageNet-16-120

Metric: Search time (s) (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Search time (s)▼	Augmentations	Paper	Date↕	Code
1	Local search	151200	No	Exploring the Loss Landscape in Neural Architect...	2020-05-06	Code
2	BANANAS	100800	No	BANANAS: Bayesian Optimization with Neural Archi...	2019-10-25	Code
3	NASBOT	75600	No	Neural Architecture Search with Bayesian Optimis...	2018-02-11	Code
4	DARTS (second order)	29902	No	DARTS: Differentiable Architecture Search	2018-06-24	Code
5	GDAS	28926	No	Searching for A Robust Neural Architecture in Fo...	2019-10-10	Code
6	CATCH-meta	18000	No	CATCH: Context-based Meta Reinforcement Learning...	2020-07-18	-
7	ENAS	13315	No	-	-	-
8	REA	12000	No	Regularized Evolution for Image Classifier Archi...	2018-02-05	Code
9	DARTS (first order)	10890	No	DARTS: Differentiable Architecture Search	2018-06-24	Code
10	FairNAS	9845	No	FairNAS: Rethinking Evaluation Fairness of Weigh...	2019-07-03	Code
11	RSPS	7587	No	Random Search and Reproducibility for Neural Arc...	2019-02-20	Code
12	GenNAS	1080	No	Generic Neural Architecture Search via Regression	2021-08-04	Code
13	EPE-NAS (N=1000)	206.2	No	EPE-NAS: Efficient Performance Estimation Withou...	2021-02-16	Code
14	EPE-NAS (N=500)	105.8	No	EPE-NAS: Efficient Performance Estimation Withou...	2021-02-16	Code
15	EPE-NAS (N=100)	20.5	No	EPE-NAS: Efficient Performance Estimation Withou...	2021-02-16	Code
16	NAS without training (N=100)	17.4	No	Neural Architecture Search without Training	2020-06-08	Code
17	DiNAS	15.36	No	Multi-conditioned Graph Diffusion for Neural Arc...	2024-03-09	Code
18	EPE-NAS (N=10)	2.3	No	EPE-NAS: Efficient Performance Estimation Withou...	2021-02-16	Code
19	NAS without training (N=10)	1.7	No	Neural Architecture Search without Training	2020-06-08	Code

#1Local searchSOTA
151200
Search time (s)· 2020-05-06
Exploring the Loss Landscape in Neural Architecture Search Code
#2BANANASSOTA
100800
Search time (s)· 2019-10-25
BANANAS: Bayesian Optimization with Neural Architectures for Neural Architecture Search Code
#3NASBOTSOTA
75600
Search time (s)· 2018-02-11
Neural Architecture Search with Bayesian Optimisation and Optimal Transport Code
#4DARTS (second order)
29902
Search time (s)· 2018-06-24
DARTS: Differentiable Architecture Search Code
#5GDAS
28926
Search time (s)· 2019-10-10
Searching for A Robust Neural Architecture in Four GPU Hours Code
#6CATCH-meta
18000
Search time (s)· 2020-07-18
CATCH: Context-based Meta Reinforcement Learning for Transferrable Architecture Search
#7ENAS
13315
Search time (s)
No paper
#8REASOTA
12000
Search time (s)· 2018-02-05
Regularized Evolution for Image Classifier Architecture Search Code
#9DARTS (first order)
10890
Search time (s)· 2018-06-24
DARTS: Differentiable Architecture Search Code
#10FairNAS
9845
Search time (s)· 2019-07-03
FairNAS: Rethinking Evaluation Fairness of Weight Sharing Neural Architecture Search Code
#11RSPS
7587
Search time (s)· 2019-02-20
Random Search and Reproducibility for Neural Architecture Search Code
#12GenNAS
1080
Search time (s)· 2021-08-04
Generic Neural Architecture Search via Regression Code
#13EPE-NAS (N=1000)
206.2
Search time (s)· 2021-02-16
EPE-NAS: Efficient Performance Estimation Without Training for Neural Architecture Search Code
#14EPE-NAS (N=500)
105.8
Search time (s)· 2021-02-16
EPE-NAS: Efficient Performance Estimation Without Training for Neural Architecture Search Code
#15EPE-NAS (N=100)
20.5
Search time (s)· 2021-02-16
EPE-NAS: Efficient Performance Estimation Without Training for Neural Architecture Search Code
#16NAS without training (N=100)
17.4
Search time (s)· 2020-06-08
Neural Architecture Search without Training Code
#17DiNAS
15.36
Search time (s)· 2024-03-09
Multi-conditioned Graph Diffusion for Neural Architecture Search Code
#18EPE-NAS (N=10)
2.3
Search time (s)· 2021-02-16
EPE-NAS: Efficient Performance Estimation Without Training for Neural Architecture Search Code
#19NAS without training (N=10)
1.7
Search time (s)· 2020-06-08
Neural Architecture Search without Training Code