Data-free Knowledge Distillation on SQuAD
Metric: Exact Match (higher is better)
Metric: Exact Match (higher is better)
| # | Model↕ | Exact Match▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | GOLD (T5-base) | 75.2 | No | GOLD: Generalized Knowledge Distillation via Out... | 2024-03-28 | - |
| 2 | Prompt2Model (T5-base) | 74.4 | No | Prompt2Model: Generating Deployable Models from ... | 2023-08-23 | Code |
| 3 | ZeroGen (T5-base) | 69.4 | No | ZeroGen: Efficient Zero-shot Learning via Datase... | 2022-02-16 | Code |
| 4 | ProGen (T5-base) | 68.1 | No | ProGen: Progressive Zero-shot Dataset Generation... | 2022-10-22 | Code |