FQ-160

The forbidden question dataset they build (based on two previous works) contains 160 questions from 160 violated categories. In addition, they also provide the corresponding targets – which is useful for some jailbreak methods, such as GCG.