The Analog Activation Function

Reported on 4 benchmarks across 1 task

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision4 results

Image ClassificationonCIFAR-10
Cross Entropy Loss
0.5551
Image ClassificationonCIFAR-10
Parameters
545100
Image ClassificationonCIFAR-10
Percentage correct
82.06
best: 99.5 (ViT-H/14)
Image ClassificationonCIFAR-10
Top 1 Accuracy
82.06
best: 98.8 (DGMMC-S)