SAS-Bench

SAS-Bench represents the first specialized benchmark for evaluating Large Language Models (LLMs) on Short Answer Scoring (SAS) tasks. Utilizing authentic questions from China's National College Entrance Examination (Gaokao), our benchmark offers:

• 1,030 questions spanning 9 academic disciplines
• 4,109 expert-annotated student responses
• Step-wise scoring with Step-wise error analysis
• Multi-dimensional evaluation (holistic scoring, step-wise scoring, and error diagnosis consistency)