AI Governance Validation Instrument

S.T.E.E.R.
AI governance, validated — not assumed.

A working instrument, not a slide. Apply all five phases — Situate, Tension-test, Establish, Evidence, Roll out & review — to your own organization's risks, stakeholders, and regulatory exposure, and leave with a scored governance posture.

PM
ContributorPawan Maheshwari
EXECUTIVES & BOARDSLEGISLATORS & REGULATORSRESEARCHERSRISK & COMPLIANCEBUILDERS
01AccountabilityA named human answers for every consequential model decision.
02TransparencyPurpose, data, and limits are documented and discoverable.
03FairnessDisparate impact is measured, not presumed absent.
04Human oversightOverride paths exist and are exercised, not theoretical.
05RobustnessSystems fail safely, are monitored, and can be withdrawn.
RUNNING CASE

Helios Capital — a mid-size retail bank operating in the EU and India. Two AI systems in production: an ML credit-scoring model (high-risk under the EU AI Act) and a GenAI customer assistant built on a foundation model. Every output below carries a worked Helios example. Replace Helios with your organization as you go.

Start here — your caseEverything you enter flows into the workspaces below and your exported board report
Phase oneOutput · Landscape scan & stakeholder map
S

Situate

You cannot govern what you cannot see — find every system, sanctioned or not.

Where does AI actually live in your organization, and who has power over it?

1.1

Strategic context & AI footprint map

Inventory every AI system by purpose, criticality, data sensitivity, and decision authority (advisory vs. autonomous).

17 systems found across 6 business units. 2 make autonomous decisions (credit limits, fraud blocks); 11 are advisory; 4 are vendor-embedded and previously invisible to risk.
1.2

Shadow AI identification

Surface ungoverned use: personal LLM accounts, browser extensions, vendor features quietly switched on, spreadsheet macros calling APIs.

Amnesty survey + expense-line scan revealed 240 staff pasting customer correspondence into consumer chatbots, and an HR tool's "AI ranking" feature enabled by default since 2024.
1.3

Governance gap assessment & priority matrix

Score each system on impact × oversight maturity. The top-right quadrant — high impact, low oversight — is your burn-down list.

Credit scoring: impact 5/5, oversight 2/5 → Priority 1. GenAI assistant: impact 4/5, oversight 1/5 → Priority 2. Marketing copy generator: impact 2/5 → monitor only.
1.4

Stakeholder map — power/interest grid

Map regulators, board, unions, customers, model owners, and civil society on power vs. interest. The grid below is interactive — tap a stakeholder.

RBI & EU market-surveillance authority: high power / high interest → manage closely with proactive disclosure, not reactive responses.

Interactive — power / interest grid (Helios)

High power · Low interest
Keep satisfied
Group CFO Data Protection Authority
High power · High interest
Manage closely
Board Risk Committee Banking regulators Chief Risk Officer
Low power · Low interest
Monitor
General staff Non-AI vendors
Low power · High interest
Keep informed
Declined applicants Credit officers Civil society
INTEREST →↑ POWER (VERTICAL)
Your workspace — SituateYour organization

Build your AI footprint map. Priority is computed automatically from impact × oversight gap — your burn-down list forms itself.

No systems added yet — your inventory appears here.

Map your stakeholders. The engagement strategy is assigned by quadrant.

No stakeholders mapped yet.

Validate — Situate0 / 10

NOT STARTED

A complete AI inventory exists, including vendor-embedded and shadow systems, refreshed at least quarterly.

NOT STARTED

Every system is classified by decision authority (advisory / autonomous) and data sensitivity.

NOT STARTED

A shadow-AI amnesty or detection mechanism has run in the last 6 months.

NOT STARTED

Governance gaps are scored on an impact × oversight matrix with a named priority list.

NOT STARTED

A stakeholder power/interest map exists with an engagement strategy per quadrant.

Tap to cycle: Not started → In progress (1) → Evidenced (2). Scores feed the health gauge.
Phase twoOutput · Fairness audit & ethical red lines
T

Tension-test

Trade-offs are inevitable — make them explicit, decide them deliberately.

Governance is not about eliminating trade-offs. It is about deciding them in the open — and writing down what you will never trade.

2.1

Bias pipeline analysis

Trace bias entry points across the lifecycle: historical data → labels → features → objective function → thresholds → human use.

Helios found "pin-code" acted as a proxy for religion and caste in Indian portfolios; 1990s repayment data encoded redlining-era patterns into "creditworthiness."
2.2

Fairness tensions & trade-off register

Log each tension (accuracy vs. equity, personalization vs. privacy, speed vs. review), the options considered, the decision, and the owner.

Register entry T-04: equalizing approval rates across protected groups costs 1.8% portfolio accuracy. Decided: accept cost; CRO signed; revisit at annual model review.
2.3

Ethical red lines for your context

Non-negotiables that no business case can override. Few, absolute, board-ratified.

Helios ratified five red lines (below), including "no fully autonomous loan denial without human appeal path" — invoked once in 2026 to block a vendor feature.
2.4

Non-discrimination compliance check

Test outcomes against applicable law: EU AI Act Art. 10 (data governance), ECOA-style fair-lending rules, Indian DPDP Act, local equality statutes.

Quarterly disparate-impact test: approval-rate ratio across gender held at 0.91 (above the 0.80 internal floor); one regional anomaly escalated to the council in Q1.

Interactive — feel the trade-off (Helios credit model)

Drag the threshold. There is no setting where nothing is sacrificed — which is precisely why the decision must be owned, documented, and reviewable.

◀ MAXIMIZE ACCURACYMAXIMIZE PARITY ▶

Helios — ethical red lines (board-ratified)

1

No fully autonomous adverse decision. Every loan denial, account closure, or fraud freeze has a human appeal path with a 10-day SLA.

2

No protected attributes or close proxies as features. Proxy audit (pin-code, name, device language) runs at every retrain.

3

No customer data into external models without contractual no-training guarantees and regional data residency.

4

No deployment of an undocumented model. No model card, no production — regardless of revenue at stake.

5

No dark patterns from the GenAI assistant. It must disclose it is AI, must not impersonate staff, and must hand off on request.

Your workspace — Tension-testYour organization

Write your ethical red lines — few, absolute, board-ratifiable.

No red lines yet — aim for three to six.

Log your fairness tensions and the decisions you've made — owned trade-offs, not hidden ones.

Trade-off register is empty.

Validate — Tension-test0 / 10

NOT STARTED

Bias entry points are mapped across the full pipeline for each high-impact system.

NOT STARTED

A trade-off register exists with decisions, rationale, named owners, and review dates.

NOT STARTED

Ethical red lines are written, board-ratified, and have actually blocked at least one proposal (or are credibly enforceable).

NOT STARTED

Disparate-impact metrics are measured on production outcomes, not just training data.

NOT STARTED

Fairness definitions used (parity, equalized odds, calibration) are chosen deliberately and documented per use case.

A red line that has never cost you anything may not be a red line.
Phase threeOutput · Governance charter & policy framework
E

Establish

Principles without decision rights are poetry — name who decides.

Who decides, who is consulted, who can veto — and what happens when they disagree?

3.1

Governance principles — tensions acknowledged

State each principle alongside the tension it creates, so the charter reads as honest rather than aspirational.

"We pursue innovation velocity AND demand pre-deployment review — when they conflict, risk tier decides: Tier 1 waits, Tier 3 ships with monitoring."
3.2

AI Governance Council — charter & membership

A standing cross-functional body with quorum rules, cadence, veto rights, and a published escalation path to the board.

Helios council: CRO (chair), CDO, CISO, General Counsel, Head of Data Science, business-line lead, employee representative, external ethics advisor. Monthly; quorum 5; CRO veto on Tier 1.
3.3

Roles, decision rights & accountability

A decision-rights table (below) so every consequential call has exactly one accountable name — committees advise, individuals answer.

Tier 1 deployment approval: Accountable = CRO. Model retraining sign-off: Accountable = model owner. Red-line exception: nobody — escalate to board.
3.4

Policy framework & council design

A small policy stack — acceptable use, procurement, data, incident response, model lifecycle — each mapped to an owner and review cycle.

5 policies, each ≤4 pages, owned, reviewed annually. The acceptable-use policy is the only one all 12,000 staff must read; the rest bind specific roles.

Helios — decision rights (RACI extract)

DecisionAccountableConsultedVeto held byTier
Approve high-risk system for productionChief Risk OfficerCouncil, Legal, DPOCROTIER 1
Approve new external GenAI toolCDOCISO, ProcurementCISO (security)TIER 2
Retrain / threshold change, existing modelModel ownerValidation teamHead of Model RiskTIER 2
Low-risk internal productivity useBusiness-line lead——TIER 3
Exception to a red lineNone — not delegableFull boardBoard Risk CommitteeBOARD
Your workspace — EstablishYour organization

Assign your decision rights — every consequential decision gets exactly one accountable name.

No decision rights assigned yet.

Validate — Establish0 / 10

NOT STARTED

A governance council exists with a written charter, quorum rules, and a board escalation path.

NOT STARTED

Every consequential AI decision type maps to exactly one accountable individual.

NOT STARTED

A risk-tiering scheme determines which approvals each system needs before deployment.

NOT STARTED

The policy stack is short, owned, versioned, and reviewed on a fixed cycle.

NOT STARTED

Stated principles explicitly acknowledge the tensions they create and how conflicts are resolved.

If two people believe they own the same decision, nobody owns it.
Phase fourOutput · Documentation & assurance layer
E

Evidence

Governance is whatever you can prove in 48 hours.

When the regulator, the auditor, or the journalist calls — everything else is intention.

4.1

Model card — applied to your systems

One card per production system: purpose, data lineage, performance by subgroup, known limits, and the human-oversight design. Expand the live template below.

Helios credit model card v3.2: 14 sections, 6 pages, subgroup AUC table, "do not use for" list, owner + reviewer signatures, next-review date on the cover.
4.2

Decision log structure

An append-only register of governance decisions: what, who, when, evidence considered, dissent recorded. Dissent is data, not noise.

Entry DL-2026-014: GenAI assistant scope extension to investment FAQs — approved 6–1; employee representative's dissent (mis-selling risk) logged with mitigations attached.
4.3

Regulatory compliance map

One cross-walk from EU AI Act articles to NIST AI RMF functions to ISO/IEC 42001 clauses — so one piece of evidence serves three frameworks (table below).

Helios's single risk-assessment artifact satisfies EU AI Act Art. 9, NIST MAP/MEASURE, and ISO 42001 §6.1 simultaneously — written once, cited thrice.
4.4

Audit trail & assurance mechanisms

Immutable logs of model versions, inputs to consequential decisions, overrides, and incidents — plus periodic independent review.

Every credit decision stores model version, feature snapshot hash, score, threshold, and reviewer ID for 7 years; internal audit replays a 1% sample quarterly.

Live template — model card (expand sections)

1System overview & intended use
What the model does, for whom, and explicitly what it must not be used for.SYSTEM: Helios Retail Credit Score v3.2 PURPOSE: Rank-order default risk for unsecured retail lending ≤ €50k DECISION AUTHORITY: Advisory below threshold band; autonomous approval only — denial always human-reviewed OUT OF SCOPE: SME lending · employment screening · insurance pricing
2Data lineage & governance
Sources, time ranges, consent basis, exclusions, and known gaps.SOURCES: Core banking (2014–2025) · bureau data (licensed) · application form EXCLUDED: Pin-code, name tokens, device language (proxy risk — see red line 2) KNOWN GAP: Thin-file applicants under-represented (8% of training vs 19% of applicants)
3Performance — including by subgroup
Aggregate metrics hide the story; subgroup tables tell it.AUC overall: 0.81 · Gender approval-rate ratio: 0.91 · Age 60+: AUC 0.74 ⚠ flagged CALIBRATION: Within ±2pts across regions except NE cluster (remediation ticket MR-118)
4Human oversight & appeal design
Who can override, how it is logged, and how appeals work.OVERRIDE: Credit officers, ±1 band, rationale mandatory, monthly pattern review APPEAL: Customer-initiated, human re-decision, 10-day SLA, outcomes published annually
5Limits, risks & review schedule
Honest limitations and the date this card expires.LIMITS: Degrades under macro shock (2020 backtest); thin-file bias under remediation OWNER: A. Rao (Model Risk) · REVIEWED BY: Validation + DPO · NEXT REVIEW: 2026-09-30

Compliance cross-walk — write once, satisfy three

Governance artifactEU AI ActNIST AI RMFISO/IEC 42001
Risk assessment & tieringArt. 9 — risk managementMAP · MEASURE§6.1 risk & opportunity
Model card + data lineageArt. 10–11, Annex IVMAP 1.6 / MEASURE 2.x§7.5 documented info
Human-oversight designArt. 14 — oversightGOVERN 3 / MANAGE 2§8 operational control
Decision log + audit trailArt. 12 — record-keepingGOVERN 4 / MANAGE 4§9.1 monitoring
Incident & withdrawal procedureArt. 73 — serious incidentsMANAGE 4.1–4.3§10 improvement
Your workspace — EvidenceYour organization

Your documentation ledger. Systems you added in Situate appear here automatically — tap a status to cycle it (None → Draft → Signed). Red line 4 applies: no model card, no production.

Add AI systems in the Situate workspace to track their model cards here.

Validate — Evidence0 / 10

NOT STARTED

Every production AI system has a current, signed model card with subgroup performance.

NOT STARTED

An append-only decision log captures rationale and dissent for governance decisions.

NOT STARTED

A single cross-walk maps your evidence to EU AI Act, NIST AI RMF, and ISO 42001.

NOT STARTED

Consequential decisions are reproducible: model version, inputs, and override identity are retained.

NOT STARTED

An independent party (internal audit or external) has tested the assurance layer in the last 12 months.

The 48-hour test: could you hand a regulator this evidence by Friday?
Phase fiveOutput · 90-day action plan & health scorecard
R

Roll out & review

Governance dies two ways: it never ships, or it ships and is never reviewed.

A 90-day plan with named owners prevents the first. A quarterly scorecard prevents the second.

"By 2027, every consequential AI decision at Helios will be explainable to the customer it affects, defensible to the regulator who asks, and reversible by the human who owns it."

Helios — board-ratified governance vision statement · Output 1 of 5

Helios — prioritized 90-day plan · named owners · S.T.E.E.R.-mapped

1–30Quick wins — visible, cheap, momentum-building

Run shadow-AI amnestyNo-penalty disclosure window + tool survey.
S · SITUATEOWNER: CISO
Publish acceptable-use policy (1 page)What's green, amber, red for all 12,000 staff.
E · ESTABLISHOWNER: CDO
Stand up the AI inventory registerSeed with the 17 known systems; make additions mandatory at procurement.
S · SITUATEOWNER: Head of Architecture
Draft the 5 red lines for board ratification
T · TENSION-TESTOWNER: CRO

31–60Structure — councils, rights, and the first audit

Convene the AI Governance CouncilCharter signed; first meeting decides the Tier-1 backlog.
E · ESTABLISHOWNER: CRO (chair)
Fairness audit of the credit modelBias-pipeline analysis + subgroup metrics on live outcomes.
T · TENSION-TESTOWNER: Head of Model Risk
Model card for both Tier-1 systemsUsing the template; signed by owner + DPO.
E · EVIDENCEOWNER: Model owners

61–90Assurance — prove it works, then report up

Compliance cross-walk completedEU AI Act / NIST / ISO 42001 mapping with gap register.
E · EVIDENCEOWNER: General Counsel
Incident & model-withdrawal drillTabletop: GenAI assistant gives harmful financial advice — rehearse the kill switch.
R · ROLL OUTOWNER: CISO
First quarterly health scorecard to boardBaseline scores + 12-month targets.
R · ROLL OUTOWNER: CRO

Stakeholder communication plan — by audience

AudienceMessageChannel & cadenceOwner
BoardRisk posture, red-line status, health scorecard trendQuarterly committee paperCRO
RegulatorsProactive disclosure of Tier-1 changes; evidence readinessPre-notification + annual briefGeneral Counsel
All staffWhat you may use, how to report concerns — no jargonLaunch town hall + intranet hubCDO
CustomersWhere AI touches them, how to appeal a decisionPlain-language fact sheet, always-onHead of CX
Researchers / publicMethodology transparency; published fairness statisticsAnnual transparency reportCouncil
Your workspace — Roll out & reviewYour organization

Write your board-ready vision statement — one sentence, ratifiable.

Your governance vision statement

Build your 90-day plan — every action needs a named owner and a S.T.E.E.R. phase.

1–30

No quick wins yet.

31–60

Nothing scheduled.

61–90

Nothing scheduled.

Validate — Roll out & review0 / 10

NOT STARTED

A board-ready governance vision statement exists in one sentence, ratified — not drafted.

NOT STARTED

The 90-day plan has named individual owners and each action maps to a S.T.E.E.R. phase.

NOT STARTED

At least three 30-day quick wins are complete and visible to staff.

NOT STARTED

Each stakeholder audience has a defined message, channel, cadence, and owner.

NOT STARTED

The health scorecard is reviewed quarterly and at least one action changed because of it.

A scorecard that never changes a decision is decoration.
Quarterly reviewComputed live from your validations

Governance health scorecard

0
of 50 · Governance Health Index
Exposed
AI is in use without visibility or control. Start with Situate — you cannot govern what you cannot see.
Situate
0/10
Tension-test
0/10
Establish
0/10
Evidence
0/10
Roll out
0/10
0–10 Exposed · no visibility 11–20 Reactive · incident-driven 21–30 Defined · structures exist 31–40 Managed · evidenced & audited 41–50 Steered · governance shapes strategy

Data lives in this browser session only — download your .json to save progress and import it later to resume.