Llama-3-8B-Instruct

Reported on 2 benchmarks across 2 tasks · 2 papers

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Sentence OrderingonEconLogicQA
Accuracy· 2024-05-13
0.3462
best: 0.5692 (GPT-4-Turbo)
EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential Reasoning arXiv:2405.07938
Code GenerationonPECC
Pass@3· 2024-04-29
3.1
best: 27.67 (Claude 3 Haiku)
PECC: Problem Extraction and Coding Challenges arXiv:2404.18766