For enterprise leaders, risk management AI requires assessing both its contribution to risk decisions and the controls on the system doing that work. Start by defining what it may read, recommend and change, then require evidence for each permission before release.

Key takeaways

  • Separate permission to access data from permission to make operational changes, and approve each against its own evidence.
  • Assign an owner to every consequential decision, including accepting residual risk and stopping the system.
  • Test missing evidence, unauthorized access and partial failure before approving normal operation.
  • Limit automatic action to cases whose consequences, detection and recovery you can demonstrate.

Separate AI-assisted risk work from the system’s own risk assessment

Define two workstreams in your project brief. The first should specify the risk task you want AI to support, such as preparing evidence for a supplier review or flagging records for investigation. The second should assess whether the proposed system may perform that task with the selected data, permissions and controls.

Keep their acceptance criteria separate. For the risk task, ask whether a reviewer receives relevant evidence and a useful recommendation. For the system, ask whether unauthorized inputs stay inaccessible, unsupported conclusions trigger escalation and prohibited actions remain blocked.

NIST provides a framework for managing AI-associated risks to individuals, organizations and society (NIST). When defining who could be affected by your system, consider effects on individuals as well as organizations. Include the person subject to a decision, not just the department operating the software.

Write the initial scope as a concrete instruction: prepare a supplier-risk review from approved documents, identify missing evidence and route the draft to the designated reviewer. Explicitly exclude approving suppliers, changing payment details and accepting contractual terms. Use the same scope statement in the project brief, permission configuration and acceptance record.

For the broader operating model, use our explanation of what an AI business layer is alongside this system-level assessment. Keep this article’s checklist attached to one defined process rather than treating it as approval for every AI use across the business.

Build a decision record that connects each risk to an owner

Use a decision record as the central working document. For every material failure scenario, record the affected decision, the evidence required, the control, its test and the person authorized to accept the remaining exposure. Avoid entries that stop at broad categories such as privacy or accuracy.

MIT’s AI Risk Initiative provides a risk repository, an incident tracker and governance resources for identifying and examining AI risks (MIT AI Risk Initiative). Use those resources to challenge the completeness of your assessment. Translate relevant risks into failures that your operating team can recognize and test.

Write failures as observable scenarios

Replace an entry such as inaccurate output with a specific scenario: the system recommends approval despite an expired supporting document. Record what should happen instead, including whether the system must abstain, request evidence or escalate. Then assign someone to verify that behavior before release.

For each scenario, answer these questions:

  • What decision or action could be wrong?
  • Who could be affected, and which information is needed to assess the consequence?
  • Which control should prevent or detect the failure?
  • What test would demonstrate that the control works within the approved scope?
  • Who may accept the residual risk, and who may stop operation?

Assign authority by decision

As a working owner map, make the operations owner responsible for process scope and manual fallback. Assign IT and security the access-boundary and technical-control decisions. Ask risk, privacy and legal specialists to assess the requirements relevant to their remit, and name an executive sponsor to accept material residual business risk within established authority.

Keep release approval distinct from day-to-day exception handling. A reviewer may approve an individual recommendation without having authority to expand the system’s permissions. Record both authorities so that an urgent exception does not silently become a permanent scope change.

Implement two release gates and test the boundary of each

Compsia’s internal release standard separates approval for a new real-data path from approval for recurring, action-capable production (how we scope trust and claims per system). Apply that distinction as a practical release method. Give each gate its own evidence packet, named approver and unresolved-issues list.

Gate A: authorize the data path

Before introducing sensitive operational material, document the complete processing path. Include inputs, providers, intermediate copies, outputs, retained records and authorized users. Require the relevant reviewers to approve that exact path rather than a product name or hosting label.

Use these acceptance checks:

  • Record the approved data categories, processing locations, providers and retention rules.
  • Verify access with allowed and disallowed users, including access after a role change.
  • Test deletion and export against the copies included in the system design.
  • Name the incident owner and demonstrate the escalation procedure.
  • Confirm that write operations remain unavailable unless separately approved.

Do not waive this gate because a person will review the output. Make confidentiality and access tests independent of output review. If reviewers cannot establish the processing path, narrow the material used until they can.

Gate B: authorize consequential actions

Before enabling writes, define the exact allowed operations and the conditions attached to each. Require authenticated approval for the consequential actions you designate, with the approval tied to the specific proposed change. Prohibit operations that have no agreed recovery or escalation path.

Test duplicate requests, expired approval, changed source records and interrupted execution. Require the system to distinguish an action that never started from one that completed before a connection failed. Where that distinction cannot be established, route the item for reconciliation instead of permitting an unchecked retry.

Store the deployment version, test evidence, accepted limitations and rollback instructions in the release record. Compsia’s system release standard also requires named incident and continuity ownership, acceptance and failure tests, and manual fallback (system-specific trust boundaries). Use the same discipline when the build is internal or another supplier operates it.

Work through a supplier-review pattern before enabling approval

To work through these release decisions, start with supplier-risk intake as the example process. Scope an initial release to extract information from authorized submissions, identify missing documents and prepare a review draft. Keep supplier approval and risk acceptance outside its permissions.

Specify the review package before choosing the model. Require each material recommendation to include its supporting document, the relevant passage, the document version and any unresolved contradiction. Instruct the system to mark absent evidence as missing rather than complete the assessment through inference.

Build acceptance cases around the decisions reviewers must make. Include an expired document, inconsistent answers across submissions, a file outside the reviewer’s access and an attachment containing instructions to ignore the review rules. For each case, write the expected behavior before running the test.

Require the reviewer to choose among requesting evidence, escalating a concern or approving the draft for the next process step. Keep that choice separate from accepting the supplier’s residual risk. An approved draft should not grant the system authority to approve the underlying business relationship.

For an initial action-capable release, permit only the specific handoff that passes acceptance, such as creating a review task with an evidence package. Leave approval status unchanged. Use our AI Agent Write Access permission model when defining the distinction between preparing a change and executing it.

Before expanding scope, rerun the assessment against the new action. Treat permission to change a supplier status as a separate release decision, even if the same model and documents remain in use. Require new evidence for the operational consequence, approval enforcement and recovery behavior.

Set launch limits around review capacity and recovery

Do not approve a human-review control solely because the process includes an approval button. Demonstrate that reviewers can inspect the evidence, understand uncertainty and reject a recommendation without losing the underlying work. Assign an escalation route for cases that exceed their authority or expertise.

The International AI Safety Report’s technical-safeguards update identifies continuing gaps in defenses and uncertainty about the real-world effectiveness of many safeguards (International AI Safety Report). Treat that as a reason to test the complete operating process. Do not infer acceptable business risk from a safeguard’s presence alone.

Test whether review remains meaningful under load

During acceptance, give reviewers the proposed volume and mix of cases, including ambiguous and incomplete submissions. Check whether they can explain why they accepted or rejected material recommendations. If they cannot, reduce volume, improve the evidence package or narrow the permitted decisions before launch.

Define a queue limit and specify what happens when it is reached. Prefer pausing new work or routing it to the agreed manual process over quietly weakening review. Name the person authorized to make that operational choice.

Approve action only when failure handling is demonstrated

Use a consequence-and-recovery rule for each proposed action. Require evidence that the responsible team can detect an incorrect action, identify its effects and execute the agreed recovery or escalation procedure. If any part remains unproven, retain approval gating or exclude the action from the release.

The release owner should approve only the narrowest scope that passes both gates and has an accountable operating owner. If essential data access, test evidence or fallback remains unresolved, defer the launch until those requirements are met. Operation must stop if no authorized person will own the consequential decisions or if the permitted scope no longer justifies operating the system.

Include these decisions in the operating agreement, with review triggers for new data categories, new receiving systems and expanded permissions. Use our managed AI operations approach as a companion when assigning responsibility after launch.

Frequently asked questions

How is AI used in risk management?

For an initial implementation, assign AI supporting tasks such as extracting evidence, identifying missing information and drafting review questions. Require source-linked output and retain consequential decisions with the authorized risk owner. NIST’s generative AI profile offers actions intended to help organizations address risks in line with their goals and priorities (NIST).

What are the 5 C's of risk management?

Ask which framework the speaker means before adopting a five-C checklist. For this implementation method, use context, consequence, controls, consent and continuity as a working mnemonic, not an attributed industry standard. Translate those terms into scope, affected decisions, tested safeguards, authorized access and action, and a usable fallback.

What is the 30% rule of AI?

Do not use a 30% rule as a release criterion without a defined meaning, evidence and scope. Ask whether the proposed percentage refers to workload, review sampling, expected benefit or something else. For consequential actions, require permission-specific acceptance tests rather than substituting a percentage for a risk decision.

Can ChatGPT do a risk assessment?

If you use ChatGPT in a risk assessment, restrict its assigned role to drafting or evidence organization until the workflow passes your acceptance tests. Provide only authorized material, verify material statements against their sources and require the accountable specialist to approve the assessment. Treat that approval as a separate decision from whether the tool may access data or execute changes.

Choose one process and name its release owner

Bring one recurring risk process to a scoping discussion, together with its current review steps, evidence requirements and approval authorities. Compsia designs, deploys and operates custom AI production systems, defining each system’s data, actions, owners, controls, acceptance tests and operating limits. Review how Compsia designs, launches and operates a production system, then decide which data path and action boundary should be assessed first.

We look at how your team runs its core processes and show you what we would make more efficient.

Primary references

  1. AI Risk Management FrameworkNational Institute of Standards and Technology
  2. MIT AI Risk InitiativeMIT AI Risk Initiative
  3. International AI Safety ReportInternational AI Safety Report

Continue reading: AI Agent Write Access: A Safe Permission Model.