FDE01Forward deployment
Handbook 09

Make human review effective

Reviewers need enough information, time and authority.

On this pageChapter guideDiscussion questionRelated exercise

Chapter guide

Reviewers need evidence, time, skills, authority and an understanding of the consequences. Without these, clicking approve may be a formality. Count review workload and waiting time when planning the pilot.

Design rejection, correction, takeover, appeal and recovery alongside the normal workflow. Show uncertainty and let users reject unsuitable advice.

Design with the people who will use the system, then observe them. Defaults and automation bias may encourage approval without checking. Verify that rejecting a recommendation actually stops the external action.

Where model output belongs in a workflow
Where model output belongs in a workflowIn this example, an authorized person reviews the output before the business record is updated. Reviewers need evidence, time, skills and the right to reject.Task & permissionIdentity / evidenceModel & toolsAdvice / proposed actionHuman reviewApprove / reject / take overSystem of recordAuditable final stateMissing evidence or authority: pause, investigate or hand off
In this example, an authorized person reviews the output before the business record is updated. Reviewers need evidence, time, skills and the right to reject.Swipe to view the full diagram.

Discussion question

When a user clicks reject, do subsequent actions actually stop?

Related exercise

Follow the related lesson below and try its exercise. Use the linked template to record your judgment, evidence and open questions, then revise with the checklist. With a partner, check which parts of each other’s work need clarification.