ReClor

TextsIntroduced 2020-02-11

Logical reasoning is an important ability to examine, analyze, and critically evaluate arguments as they occur in ordinary language as the definition from Law School Admission Council. ReClor is a dataset extracted from logical reasoning questions of standardized graduate admission examinations.

Source: ReClor

Benchmarks

Question Answering/Accuracy Question Answering/Accuracy (easy)Question Answering/Accuracy (hard)Reading Comprehension/Test Reading Comprehension/Accuracy Reading Comprehension/Accuracy (easy)Reading Comprehension/Accuracy (hard)Visual Question Answering (VQA)/Accuracy Visual Question Answering (VQA)/Accuracy (easy)Visual Question Answering (VQA)/Accuracy (hard)