Data-free Knowledge Distillation on Wiki-40B
Metric: Perplexity (lower is better)
LeaderboardDataset
Loading chart...
Results
Submit a result| # | Model↕ | Perplexity▲ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | OutEffHop-Bert_base | 6.209 | No | Outlier-Efficient Hopfield Layers for Large Tran... | 2024-04-04 | Code |