IMPACT

Introduced 2023-06-07

The IMPACT dataset contains 50 human created prompts for each category, 200 in total, to test LLMs general writing ability. Instructed LLMs demonstrate promising ability in writing-based tasks, such as composing letters or ethical debates. This dataset consists prompts across 4 diverse usage scenarios:

  • Informative Writing: User queries such as self-help advice or explanations for various concept
  • Professional Writing: Format involves suggestions presentations or emails in a business setting
  • Argumentative Writing: Debate positions on ethical and societal question
  • Creative Writing: Diverse writing formats such as stories, poems, and songs.