MoralChoice Survey

MoralChoice is a survey dataset to evaluate the moral beliefs encoded in LLMs. The dataset consists of:

• Survey Question Meta-Data: 1767 hypothetical moral scenarios where each scenario consists of a description / context and two potential actions
  • Low-Ambiguity Moral Scenarios (687 scenarios): One action is clearly preferred over the other.
  • High-Ambiguity Moral Scenarios (680 scenarios): Neither action is clearly preferred
• Survey Question Templates: 3 hand-curated question templates
• Survey Responses: Outputs from 28 open- and closed-sourced LLMs