Control #
A
1
.
2
Evaluate AI on distressed requests
Test how the AI responds to prompts that involve emotional distress, suicidal ideation, self-harm, or risk of harm to others. It must de-escalate, hand off, or refuse as appropriate.
Evidence
We'll list specific evidence that demonstrates compliance with this control. Typically, this is screenshots, proof of a legal or operational policy, or product demonstrations.
Recommended actions
We'll recommend specific practices and actions for complying with this control.