Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/AlphaLLM (with MCTS)

AlphaLLM (with MCTS)

Reported on 7 benchmarks across 6 tasks · 1 paper · 2 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Reasoning3 results

Arithmetic ReasoningonGSM8K
Accuracy· 2024-04-18
92
best: 97.72 (Claude 3.5 Sonnet (HPT))
SOTA
Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing arXiv:2404.12253
Math Word Problem SolvingonMATH
Accuracy· 2024-04-18
51
best: 89.7 (Gemini 2.0 Flash Experimental)
Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing arXiv:2404.12253
Arithmetic ReasoningonGSM8K
Parameters (Billion)· 2024-04-18
70
best: 540 (PaLM 540B (Self Improvement, Self Consistency))
Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing arXiv:2404.12253

Natural Language Processing2 results

GSM8KonGSM8K
Accuracy· 2024-04-18
92
best: 98.1 (Xolver)
SOTA
Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing arXiv:2404.12253
Question AnsweringonMATH
Accuracy· 2024-04-18
51
best: 89.7 (Gemini 2.0 Flash Experimental)
Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing arXiv:2404.12253

Knowledge Base2 results

Mathematical Question AnsweringonMATH
Accuracy· 2024-04-18
51
best: 89.7 (Gemini 2.0 Flash Experimental)
Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing arXiv:2404.12253
Mathematical ReasoningonMATH
Accuracy· 2024-04-18
51
best: 89.7 (Gemini 2.0 Flash Experimental)
Toward Self-Improvement of LLMs via Imagination, Searching, and Criticizing arXiv:2404.12253