Project Toolkitby Maxime Lab

Playbook

Our AI gave a harmful answer

A user, journalist or regulator reports a wrong or unsafe output.

First 24 hours

  1. Limit the harm: disable or restrict the feature if needed.
  2. Save logs.
  3. Tell legal, security and the sponsor.

Then

  1. Find the cause: data, prompt, model or process.
  2. Contact those affected, with legal’s advice.
  3. Add the case to the evaluation set.
  4. Restart with a gate review.
Message you can adapt

At 10:40 we found the assistant gave incorrect refund advice. We’ve turned it off for refund questions and are reviewing logs. Next update at 16:00.

Avoid

Don’t blame the model. Your organization is responsible for what it puts in front of customers.

Tools for this

Last reviewed 2026-11-02 · Practitioner review pending

← All playbooks