LLM in a Flash (OPT-6.7B with Predictor)

Reported on 1 benchmark across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing1 result

Sentence CompletiononHellaSwag
Accuracy· 2023-12-12
49.8
best: 96.1 (CompassMTL 567M with Tailor)
LLM in a flash: Efficient Large Language Model Inference with Limited Memory arXiv:2312.11514