GALI(Llama3-8b-ins-4k-to-16k)

Reported on 2 benchmarks across 1 task · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Long-Context UnderstandingonLongBench
Average Score· 2025-02-04
46.22
SOTA
A Training-Free Length Extrapolation Approach for LLMs: Greedy Attention Logit Interpolation (GALI)arXiv:2502.02659
Long-Context UnderstandingonL-Eval
Average Score· 2025-02-04
59.21
SOTA
A Training-Free Length Extrapolation Approach for LLMs: Greedy Attention Logit Interpolation (GALI)arXiv:2502.02659