SUDOER

System/User Dataset for Obedience Evaluation in Responses

TextsIntroduced 2023-06-30

The dataset aims to provide system prompts and user prompts for assistant. You should make random pairs and compute human preference for both system prompt obedience and user prompt relevance through A/B testing.