NoLiMa

A benchmark extending needle-in-a-haystack (NIAH) test with a carefully designed needle set, where questions and needles have minimal lexical overlap, requiring models to infer latent associations to locate the needle within the haystack.