Tasks
SotA
Datasets
Papers
Methods
Submit
About
Datasets
/
BIG-bench (StrategyQA)
BIG-bench (StrategyQA)
Benchmarks
Logical Reasoning
/
Accuracy
Related Benchmarks
BIG-bench
/
Analogical Similarity
/
Accuracy
BIG-bench
/
Anatomy
/
Accuracy
BIG-bench
/
Astronomy
/
Accuracy
BIG-bench
/
BIG-bench Machine Learning
/
Accuracy
BIG-bench
/
Clinical Knowledge
/
Accuracy
BIG-bench
/
College Medicine
/
Accuracy
BIG-bench
/
Common Sense Reasoning
/
Accuracy
BIG-bench
/
Common Sense Reasoning
/
Accuracy
BIG-bench
/
Computer Security
/
Accuracy
BIG-bench
/
Econometrics
/
Accuracy
BIG-bench
/
Emotional Intelligence
/
Accuracy
BIG-bench
/
Ethics
/
Accuracy
BIG-bench
/
Fact Checking
/
Accuracy
BIG-bench
/
General Knowledge
/
Accuracy
BIG-bench
/
High School European History
/
Accuracy
BIG-bench
/
High School Geography
/
Accuracy
BIG-bench
/
High School Government and Politics
/
Accuracy
BIG-bench
/
High School Macroeconomics
/
Accuracy
BIG-bench
/
High School Microeconomics
/
Accuracy
BIG-bench
/
High School Psychology
/
Accuracy
BIG-bench
/
High School US History
/
Accuracy
BIG-bench
/
High School World History
/
Accuracy
BIG-bench
/
Human Aging
/
Accuracy
BIG-bench
/
Human Organs Senses Multiple Choice
/
Accuracy
BIG-bench
/
Human Sexuality
/
Accuracy
BIG-bench
/
Identify Odd Metapor
/
Accuracy
BIG-bench
/
Intent Recognition
/
Accuracy
BIG-bench
/
International Law
/
Accuracy
BIG-bench
/
Jurisprudence
/
Accuracy
BIG-bench
/
Logical Fallacies
/
Accuracy
BIG-bench
/
Logical Reasoning
/
Accuracy
BIG-bench
/
Logical Reasoning
/
Accuracy
BIG-bench
/
Management
/
Accuracy
BIG-bench
/
Marketing
/
Accuracy
BIG-bench
/
Mathematical Reasoning
/
Accuracy
BIG-bench
/
Mathematical Reasoning
/
Accuracy
BIG-bench
/
Medical Genetics
/
Accuracy
BIG-bench
/
Nutrition
/
Accuracy
BIG-bench
/
Odd One Out
/
Accuracy
BIG-bench
/
Philosophy
/
Accuracy
BIG-bench
/
Prehistory
/
Accuracy
BIG-bench
/
Professional Law
/
Accuracy
BIG-bench
/
Professional Medicine
/
Accuracy
BIG-bench
/
Professional Psychology
/
Accuracy
BIG-bench
/
Public Relations
/
Accuracy
BIG-bench
/
Reading Comprehension
/
Accuracy
BIG-bench
/
Reading Comprehension
/
Accuracy
BIG-bench
/
Security Studies
/
Accuracy
BIG-bench
/
Sociology
/
Accuracy
BIG-bench
/
US Foreign Policy
/
Accuracy
BIG-bench
/
Virology
/
Accuracy
BIG-bench
/
World Religions
/
Accuracy
BIG-bench (Anachronisms)
/
Word Sense Disambiguation
/
Accuracy
BIG-bench (Causal Judgment)
/
Common Sense Reasoning
/
Accuracy
BIG-bench (Date Understanding)
/
Common Sense Reasoning
/
Accuracy
BIG-bench (Disambiguation QA)
/
Common Sense Reasoning
/
Accuracy
BIG-bench (Formal Fallacies Syllogisms Negation)
/
Logical Reasoning
/
Accuracy
BIG-bench (Hindu Knowledge)
/
Memorization
/
Accuracy
BIG-bench (Hyperbaton)
/
Question Answering
/
Accuracy
BIG-bench (Known Unknowns)
/
Common Sense Reasoning
/
Accuracy
BIG-bench (Logic Grid Puzzle)
/
Logical Reasoning
/
Accuracy
BIG-bench (Logical Fallacy Detection)
/
Logical Reasoning
/
Accuracy
BIG-bench (Logical Sequence)
/
Common Sense Reasoning
/
Accuracy
BIG-bench (Movie Recommendation)
/
Question Answering
/
Accuracy
BIG-bench (Navigate)
/
Question Answering
/
Accuracy
BIG-bench (Novel Concepts)
/
Question Answering
/
Accuracy
BIG-bench (Penguins In A Table)
/
Logical Reasoning
/
Accuracy
BIG-bench (Reasoning About Colored Objects)
/
Logical Reasoning
/
Accuracy
BIG-bench (Ruin Names)
/
Question Answering
/
Accuracy
BIG-bench (SNARKS)
/
Sarcasm Detection
/
Accuracy
BIG-bench (Sports Understanding)
/
Common Sense Reasoning
/
Accuracy
BIG-bench (Temporal Sequences)
/
Logical Reasoning
/
Accuracy
BIG-bench (Winowhy)
/
Common Sense Reasoning
/
Accuracy
BIG-bench-lite
/
Language Modelling
/
Accuracy
Big-bench Lite
/
Auto Debugging
/
Exact string match