GLM-XXLarge (bidirectional)

Reported on 2 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical2 results

Language ModellingonWikiText-103
Test perplexity· uses extra data· 2021-03-18
11.33
best: 2.4 (RETRO (7.5B))
GLM: General Language Model Pretraining with Autoregressive Blank Infilling arXiv:2103.10360
Language ModellingonLAMBADA
Accuracy· 2021-03-18
72.35
best: 89.7 (PaLM-540B (Few-Shot))
GLM: General Language Model Pretraining with Autoregressive Blank Infilling arXiv:2103.10360