kNN-LM w/ Adaptive Coefficient

Reported on 2 benchmarks across 1 task · 1 paper · 1 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Medical2 results

Language ModellingonWikiText-103
Validation perplexity· 2022-10-28
15.72
best: 13.11 (Ensemble of All)
SOTA
You can't pick your neighbors, or can you? When and how to rely on retrieval in the $k$NN-LM arXiv:2210.15859
Language ModellingonWikiText-103
Test perplexity· 2022-10-28
15.5
best: 2.4 (RETRO (7.5B))
You can't pick your neighbors, or can you? When and how to rely on retrieval in the $k$NN-LM arXiv:2210.15859