| 1 | DeepMAD-50M | 16.1 | No | DeepMAD: Mathematical Architecture Design for De... | 2023-03-05 | Code |
| 2 | ZenNAS (1.2ms) | 16.4 | No | Zen-NAS: A Zero-Shot NAS for High-Performance De... | 2021-02-01 | Code |
| 3 | GPUNet-D3 | 16.4 | No | GPUNet: Searching the Deployable Convolution Neu... | 2022-04-26 | Code |
| 4 | GPUNet-D1 | 17.5 | No | GPUNet: Searching the Deployable Convolution Neu... | 2022-04-26 | Code |
| 5 | FBNetV3-G | 17.7 | No | FBNetV3: Joint Architecture-Recipe Search using ... | 2020-06-03 | Code |
| 6 | BossNet-T1+ | 17.8 | No | BossNAS: Exploring Hybrid CNN-transformers with ... | 2021-03-23 | Code |
| 7 | NASViT-A5 | 18.2 | No | - | - | Code |
| 8 | FBNetV5 | 18.2 | No | FBNetV5: Neural Architecture Search for Multiple... | 2021-11-19 | - |
| 9 | FBNetV5-A-CLS | 18.3 | No | FBNetV5: Neural Architecture Search for Multiple... | 2021-11-19 | - |
| 10 | NASViT-A4 | 18.6 | No | - | - | Code |
| 11 | NASViT-A3 | 19 | No | - | - | Code |
| 12 | AlphaNet-A6 | 19.2 | No | AlphaNet: Improved Training of Supernets with Al... | 2021-02-16 | Code |
| 13 | UniNet-B0 | 19.2 | No | UniNet: Unified Architecture Search with Convolu... | 2022-07-12 | Code |
| 14 | AlphaNet-A5 (base) | 19.4 | No | AlphaNet: Improved Training of Supernets with Al... | 2021-02-16 | Code |
| 15 | NAT-M4 | 19.5 | No | Neural Architecture Transfer | 2020-05-12 | Code |
| 16 | NASViT-A2 | 19.5 | No | - | - | Code |
| 17 | NSGANetV2-xl | 19.6 | No | NSGANetV2: Evolutionary Multi-Objective Surrogat... | 2020-07-20 | Code |
| 18 | FBNetV3-E | 19.6 | No | FBNetV3: Joint Architecture-Recipe Search using ... | 2020-06-03 | Code |
| 19 | AlphaNet-A5 (small) | 19.7 | No | AlphaNet: Improved Training of Supernets with Al... | 2021-02-16 | Code |
| 20 | ISyNet-N3 | 19.84 | No | ISyNet: Convolutional Neural Networks design for... | 2021-09-04 | Code |
| 21 | HardcoreNAS_E_KD | 19.9 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 22 | AttentiveNAS-A5 | 19.9 | No | AttentiveNAS: Improving Neural Architecture Sear... | 2020-11-18 | Code |
| 23 | AlphaNet-A4 | 20 | No | AlphaNet: Improved Training of Supernets with Al... | 2021-02-16 | Code |
| 24 | NAT-M3 | 20.1 | No | Neural Architecture Transfer | 2020-05-12 | Code |
| 25 | AttentiveNAS-A4 | 20.2 | No | AttentiveNAS: Improving Neural Architecture Sear... | 2020-11-18 | Code |
| 26 | SEDONA (ResNet-152 Aux. Ens., K=4) | 20.2 | No | - | - | Code |
| 27 | NASViT-A1 | 20.3 | No | - | - | Code |
| 28 | GPUNet-D0 | 20.3 | No | GPUNet: Searching the Deployable Convolution Neu... | 2022-04-26 | Code |
| 29 | FBNetV3-C | 20.4 | No | FBNetV3: Joint Architecture-Recipe Search using ... | 2020-06-03 | Code |
| 30 | BigNASModel-L | 20.5 | No | BigNAS: Scaling Up Neural Architecture Search wi... | 2020-03-24 | Code |
| 31 | HardcoreNAS_D_KD | 20.5 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 32 | ISyNet-N2 | 20.59 | No | ISyNet: Convolutional Neural Networks design for... | 2021-09-04 | Code |
| 33 | AlphaNet-A3 | 20.6 | No | AlphaNet: Improved Training of Supernets with Al... | 2021-02-16 | Code |
| 34 | AlphaNet-A2 | 20.8 | No | AlphaNet: Improved Training of Supernets with Al... | 2021-02-16 | Code |
| 35 | NSGANetV2-l | 20.9 | No | NSGANetV2: Evolutionary Multi-Objective Surrogat... | 2020-07-20 | Code |
| 36 | AttentiveNAS-A3 | 20.9 | No | AttentiveNAS: Improving Neural Architecture Sear... | 2020-11-18 | Code |
| 37 | AlphaNet-A1 | 21 | No | AlphaNet: Improved Training of Supernets with Al... | 2021-02-16 | Code |
| 38 | SEDONA (ResNet-152, K=4) | 21.09 | No | - | - | Code |
| 39 | BigNASModel-M | 21.1 | No | BigNAS: Scaling Up Neural Architecture Search wi... | 2020-03-24 | Code |
| 40 | HardcoreNAS_C_KD | 21.1 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 41 | HardcoreNAS_B_KD | 21.2 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 42 | AttentiveNAS-A2 | 21.2 | No | AttentiveNAS: Improving Neural Architecture Sear... | 2020-11-18 | Code |
| 43 | μDARTS | 21.24 | No | $μ$DARTS: Model Uncertainty-Aware Differentiable... | 2021-07-24 | - |
| 44 | NAT-M2 | 21.4 | No | Neural Architecture Transfer | 2020-05-12 | Code |
| 45 | LayerNAS-600M | 21.4 | No | LayerNAS: Neural Architecture Search in Polynomi... | 2023-04-23 | - |
| 46 | ISyNet-N1-S3 | 21.45 | No | ISyNet: Convolutional Neural Networks design for... | 2021-09-04 | Code |
| 47 | DNA-d | 21.6 | No | Blockwisely Supervised Neural Architecture Searc... | 2019-11-29 | Code |
| 48 | AttentiveNAS-A1 | 21.6 | No | AttentiveNAS: Improving Neural Architecture Sear... | 2020-11-18 | Code |
| 49 | NSGANetV2-m | 21.7 | No | NSGANetV2: Evolutionary Multi-Objective Surrogat... | 2020-07-20 | Code |
| 50 | HardcoreNAS_A_KD | 21.7 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 51 | NASViT-A0 | 21.8 | No | - | - | Code |
| 52 | HardcoreNAS_F | 21.9 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 53 | FBNetV3-A | 22 | No | FBNetV3: Joint Architecture-Recipe Search using ... | 2020-06-03 | Code |
| 54 | NoisyDARTS-A | 22.1 | No | Noisy Differentiable Architecture Search | 2020-05-07 | Code |
| 55 | AlphaNet-A0 | 22.1 | No | AlphaNet: Improved Training of Supernets with Al... | 2021-02-16 | Code |
| 56 | HardcoreNAS_E | 22.1 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 57 | ISyNet-N1-S2 | 22.15 | No | ISyNet: Convolutional Neural Networks design for... | 2021-09-04 | Code |
| 58 | DNA-c | 22.2 | No | Blockwisely Supervised Neural Architecture Searc... | 2019-11-29 | Code |
| 59 | ZenNAS (0.1ms) | 22.2 | No | Zen-NAS: A Zero-Shot NAS for High-Performance De... | 2021-02-01 | Code |
| 60 | AutoNL-L | 22.3 | No | Neural Architecture Search for Lightweight Non-L... | 2020-04-04 | Code |
| 61 | AtomNAS-C+† | 22.4 | No | AtomNAS: Fine-Grained End-to-End Neural Architec... | 2019-12-20 | Code |
| 62 | NAT-M1 | 22.5 | No | Neural Architecture Transfer | 2020-05-12 | Code |
| 63 | DNA-b | 22.5 | No | Blockwisely Supervised Neural Architecture Searc... | 2019-11-29 | Code |
| 64 | NSGANetV2-s | 22.6 | No | NSGANetV2: Evolutionary Multi-Objective Surrogat... | 2020-07-20 | Code |
| 65 | HardcoreNAS_D | 22.6 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 66 | AttentiveNAS-A0 | 22.7 | No | AttentiveNAS: Improving Neural Architecture Sear... | 2020-11-18 | Code |
| 67 | ISyNet-N1-S1 | 22.7 | No | ISyNet: Convolutional Neural Networks design for... | 2021-09-04 | Code |
| 68 | AtomNAS-B+† | 22.8 | No | AtomNAS: Fine-Grained End-to-End Neural Architec... | 2019-12-20 | Code |
| 69 | FBNetV5-AR-CLS | 22.8 | No | FBNetV5: Neural Architecture Search for Multiple... | 2021-11-19 | - |
| 70 | FBNetV2-L1 | 22.8 | No | FBNetV2: Differentiable Neural Architecture Sear... | 2020-04-12 | Code |
| 71 | FairDARTS-C | 22.8 | No | Fair DARTS: Eliminating Unfair Advantages in Dif... | 2019-11-27 | Code |
| 72 | GreedyNAS-A | 22.9 | No | GreedyNAS: Towards Fast One-Shot NAS with Greedy... | 2020-03-25 | - |
| 73 | DNA-a | 22.9 | No | Blockwisely Supervised Neural Architecture Searc... | 2019-11-29 | Code |
| 74 | HardcoreNAS_C | 22.9 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 75 | LayerNAS-300M | 22.9 | No | LayerNAS: Neural Architecture Search in Polynomi... | 2023-04-23 | - |
| 76 | SCARLET-A | 23.1 | No | SCARLET-NAS: Bridging the Gap between Stability ... | 2019-08-16 | Code |
| 77 | OFA w/ PS #75 | 23.1 | No | Once-for-All: Train One Network and Specialize i... | 2019-08-26 | Code |
| 78 | ISyNet-N1 | 23.16 | No | ISyNet: Convolutional Neural Networks design for... | 2021-09-04 | Code |
| 79 | GreedyNAS-B | 23.2 | No | GreedyNAS: Towards Fast One-Shot NAS with Greedy... | 2020-03-25 | - |
| 80 | MUXNet-l | 23.4 | No | MUXConv: Information Multiplexing in Convolution... | 2020-03-31 | Code |
| 81 | GBDT-NAS-3S | 23.5 | No | Accuracy Prediction with Non-neural Model for Ne... | 2020-07-09 | Code |
| 82 | BigNASModel-S | 23.5 | No | BigNAS: Scaling Up Neural Architecture Search wi... | 2020-03-24 | Code |
| 83 | SemiNAS | 23.5 | No | Semi-Supervised Neural Architecture Search | 2020-02-24 | Code |
| 84 | AutoNL-S | 23.5 | No | Neural Architecture Search for Lightweight Non-L... | 2020-04-04 | Code |
| 85 | HardcoreNAS_B | 23.5 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 86 | SCARLET-B | 23.7 | No | SCARLET-NAS: Bridging the Gap between Stability ... | 2019-08-16 | Code |
| 87 | AtomNAS-A+† | 23.7 | No | AtomNAS: Fine-Grained End-to-End Neural Architec... | 2019-12-20 | Code |
| 88 | DrNAS | 23.7 | No | DrNAS: Dirichlet Neural Architecture Search | 2020-06-18 | Code |
| 89 | GreedyNAS-C | 23.8 | No | GreedyNAS: Towards Fast One-Shot NAS with Greedy... | 2020-03-25 | - |
| 90 | EEEA-Net-C2 (b=7) (our) | 23.8 | No | EEEA-Net: An Early Exit Evolutionary Neural Arch... | 2021-08-13 | Code |
| 91 | MSR-DARTS (CIFAR-10) | 23.9 | No | MSR-DARTS: Minimum Stable Rank of Differentiable... | 2020-09-19 | - |
| 92 | Shapley-NAS | 23.9 | No | Shapley-NAS: Discovering Operation Contribution ... | 2022-06-20 | Code |
| 93 | b-DARTS (CIFAR-10) | 23.9 | No | $β$-DARTS: Beta-Decay Regularization for Differe... | 2022-03-03 | Code |
| 94 | DenseNAS-Large | 23.9 | No | Densely Connected Search Space for More Flexible... | 2019-06-23 | Code |
| 95 | sharpDARTS | 24 | No | sharpDARTS: Faster and More Accurate Differentia... | 2019-03-23 | Code |
| 96 | FBNetV2-F4 | 24 | No | FBNetV2: Differentiable Neural Architecture Sear... | 2020-04-12 | Code |
| 97 | GAEA PC-DARTS | 24 | No | Geometry-Aware Gradient Algorithms for Neural Ar... | 2020-04-16 | Code |
| 98 | GATES | 24.1 | No | A Generic Graph-based Neural Architecture Encodi... | 2020-04-04 | Code |
| 99 | SGAS | 24.1 | No | SGAS: Sequential Greedy Architecture Search | 2019-11-30 | Code |
| 100 | DU-DARTS | 24.1 | No | - | - | Code |
| 101 | HardcoreNAS_A | 24.1 | No | HardCoRe-NAS: Hard Constrained diffeRentiable Ne... | 2021-02-23 | Code |
| 102 | PC-DARTS (ImageNet) | 24.2 | No | PC-DARTS: Partial Channel Connections for Memory... | 2019-07-12 | Code |
| 103 | SCARLET-C | 24.4 | No | SCARLET-NAS: Bridging the Gap between Stability ... | 2019-08-16 | Code |
| 104 | EvNAS-B | 24.4 | No | Evolving Neural Architecture Using One Shot Model | 2020-12-23 | Code |
| 105 | EvNAS-A | 24.4 | No | Evolving Neural Architecture Using One Shot Model | 2020-12-23 | Code |
| 106 | LayerNAS-220M | 24.4 | No | LayerNAS: Neural Architecture Search in Polynomi... | 2023-04-23 | - |
| 107 | AlphaX-1 | 24.5 | No | AlphaX: eXploring Neural Architectures with Deep... | 2019-03-26 | Code |
| 108 | ISyNet-N0 | 24.55 | No | ISyNet: Convolutional Neural Networks design for... | 2021-09-04 | Code |
| 109 | Evo-NAS | 24.57 | No | - | - | - |
| 110 | FairNAS-A | 24.7 | No | FairNAS: Rethinking Evaluation Fairness of Weigh... | 2019-07-03 | Code |
| 111 | MUXNet-m | 24.7 | No | MUXConv: Information Multiplexing in Convolution... | 2020-03-31 | Code |
| 112 | iDARTS (ImageNet) | 24.7 | No | iDARTS: Improving DARTS by Node Normalization an... | 2021-08-25 | - |
| 113 | ProxylesNAS | 24.9 | No | ProxylessNAS: Direct Neural Architecture Search ... | 2018-12-02 | Code |
| 114 | FairNAS-B | 24.9 | No | FairNAS: Rethinking Evaluation Fairness of Weigh... | 2019-07-03 | Code |
| 115 | EvNAS-C | 25.1 | No | Evolving Neural Architecture Using One Shot Model | 2020-12-23 | Code |
| 116 | SharpSepConvDARTS | 25.1 | No | sharpDARTS: Faster and More Accurate Differentia... | 2019-03-23 | Code |
| 117 | iDARTS (CIFAR-10) | 25.2 | No | iDARTS: Improving DARTS by Node Normalization an... | 2021-08-25 | - |
| 118 | RandWire-WS (small) | 25.3 | No | Exploring Randomly Wired Neural Networks for Ima... | 2019-04-02 | Code |
| 119 | FairNAS-C | 25.4 | No | FairNAS: Rethinking Evaluation Fairness of Weigh... | 2019-07-03 | Code |
| 120 | EEEA-Net-C1 (b=7) (our) | 25.7 | No | EEEA-Net: An Early Exit Evolutionary Neural Arch... | 2021-08-13 | Code |
| 121 | MemNAS | 25.9 | No | - | - | Code |
| 122 | GDAS | 26 | No | - | - | - |
| 123 | NN-MASS-B | 26.7 | No | - | - | Code |
| 124 | DARTS | 26.7 | No | DARTS: Differentiable Architecture Search | 2018-06-24 | Code |
| 125 | FBNetV2-F3 | 26.8 | No | FBNetV2: Differentiable Neural Architecture Sear... | 2020-04-12 | Code |
| 126 | NN-MASS-A | 27.1 | No | - | - | Code |
| 127 | MUXNet-s | 28.4 | No | MUXConv: Information Multiplexing in Convolution... | 2020-03-31 | Code |
| 128 | NASGEP | 29.51 | No | Optimizing Neural Architecture Search using Limi... | 2020-05-15 | Code |
| 129 | LayerNAS-60M | 31 | No | LayerNAS: Neural Architecture Search in Polynomi... | 2023-04-23 | - |
| 130 | FBNetV2-F1 | 31.7 | No | FBNetV2: Differentiable Neural Architecture Sear... | 2020-04-12 | Code |
| 131 | MUXNet-xs | 33.3 | No | MUXConv: Information Multiplexing in Convolution... | 2020-03-31 | Code |