GLM-XXLarge (unidirectional)

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical2 results

Language ModellingonWikiText-103
Test perplexity· uses extra data· 2021-03-18
12.22
best: 2.4 (RETRO (7.5B))
GLM: General Language Model Pretraining with Autoregressive Blank Infilling arXiv:2103.10360
Language ModellingonLAMBADA
Accuracy· 2021-03-18
67.18
best: 89.7 (PaLM-540B (Few-Shot))
GLM: General Language Model Pretraining with Autoregressive Blank Infilling arXiv:2103.10360