CF07-003: Human-in-the-Loop Configuration & Adequacy

AI Control Library / CF-07: Human Oversight & Escalation

Designation: Core | Control types represented: Operational, Technical and Contextual

Control requirement

Configure human-in-the-loop workflows so reviewers have sufficient time, competence, information and authority to evaluate the relevant AI result and change the outcome. Test adequacy under realistic workload and failure conditions.

Why this matters

Adding a person to the interface can become a rubber stamp when queues, presentation or incentives discourage challenge. Adequacy depends on what the human can actually do before the consequence occurs.

How the control types work together

Operational controls define review and intervention duties. Technical controls enforce limits or supply relevant evidence. Contextual controls shape the information, interface and conditions in which people interpret results and decide whether to act.

When it applies

AI-assisted review and approval workflows, including exception handling and high-volume operational queues.

Define the assessed boundary, dependencies and evidence limitations. Tailor depth and review frequency to potential impact, and document why a particular safeguard or exclusion is appropriate to the actual deployment.

Ownership

The business process owner is accountable; operations, engineering and domain specialists design and evaluate the review environment.

Implementation guidance

  1. Define the reviewer’s decision, required evidence, authority and limits, avoiding responsibility without access or competence.
  2. Design presentation and workflow to make uncertainty, alternatives and relevant source facts usable rather than overwhelming.
  3. Set capacity, timing and escalation conditions; provide safe hold or alternative handling when review cannot be meaningful.
  4. Exercise difficult and erroneous cases at realistic load, measuring whether reviewers detect and correct material problems.

How to verify it

Use representative records and authorized controlled tests. Identify the relevant version, operating conditions and expected result before testing, and retain enough evidence to support the conclusion.

Test Expected result
Insert a controlled material error Reviewers can identify and challenge it before the consequence.
Exercise peak workload Required review remains feasible or the safe restriction activates.
Inspect interface information The reviewer can assess relevant facts rather than only a confident recommendation.

Record a finding when required results cannot be demonstrated or practice differs materially from the approved conditions. Missing evidence limits the conclusion; it should not be treated as a successful test.

Evidence to retain

  • Review workflow and capacity design
  • Authority and competency records
  • Interface and workload tests
  • Detection and correction outcomes

Protect evidence according to its sensitivity, access needs and retention rules. Avoid unnecessary copies of personal information, secrets or confidential material, while preserving the records needed for authorized review.

If the control fails

Escalate overload, rubber-stamping or insufficient information to the process owner. Reduce throughput or autonomy until meaningful review can operate.

Example in practice

Hypothetical example: A screening team has only seconds per case and sees no supporting evidence. The redesigned workflow reduces automated volume and exposes the relevant facts before approval is expected.

Related controls

Framework mappings

  • NIST AI RMF (GOVERN 5.2)
  • EU AI Act (Art. 14(4))
  • ISO 42001 (Cl. 8.2, A6.1)

Review and maintenance

Review at the interval approved by the control owner and after relevant changes, incidents or failed assessments. Update affected procedures and configuration, address evidence gaps and verify corrective action before closing findings.

Back to Human Oversight & Escalation

Version 1.0

Scroll to Top