operator runbooks
Intended Documentation
Simulate Policy Impact
Preview the effect of a policy change before deploying — read the draft impact summary (semantic diff, changed-outcome projection, rollout-safety checklist) and dry-run individual intents with POST /intent/simulate. No fictional blast-radius or drift CLI.
Simulate Policy Impact#
Before you promote a draft, preview its effect. Intended gives you two complementary tools: a draft impact summary that projects how the change shifts outcomes across a sample of traffic, and an intent-level dry run that shows exactly what a single intent would decide. Use the summary to size the change and the dry run to confirm specific cases.
No `intended policy simulate …`, no drift/blast-radius commands
There is no intended policy simulate compare, intended policy drift detect, intended policy simulate blast-radius, or intended policy pull — those CLI commands do not exist. Impact preview is the GET /policy/drafts/:id/impact-summary API (also surfaced in the console policy editor); intent dry-run is POST /intent/simulate, available as the flat simulate CLI command. A dedicated drift/blast-radius CLI is Roadmap.
Prerequisites#
- A draft created through Author a Policy.
- The
authority:policy:writepermission to read the impact summary, orintent:createto run an intent dry run. - Matching tenant scope on credential,
x-tenant-id, and bodytenantId.
Tip
Both tools are read-only. They never mutate the active runtime configuration — run them as often as you like.
Draft impact summary#
GET /policy/drafts/:id/impact-summary projects how a draft would change outcomes if deployed. It samples recent intents, re-evaluates them under the draft, and returns three things:
- A
semanticDiff— what changed between the active set and the draft, in rule terms. - An
impactprojection — sample size, the changed-outcome rate, deltas in approval load and token issuance, a confidence figure, and alowDataflag when the sample is too small to trust. - A
rolloutSafetychecklist with arecommendedModeofshadow,review, orenforce.
Reading the result#
| Field | What it tells you |
|---|---|
impact.changedOutcomeRate | Fraction of sampled intents whose decision flips under the draft. The headline number — watch decisions moving from APPROVED to DENIED/ESCALATED. |
impact.approvalLoadDelta | How many more (or fewer) intents will require human approval. |
impact.tokenIssuanceDelta | Change in tokens minted — a proxy for how many actions will now be blocked or gated. |
impact.confidence / lowData | How much to trust the projection. If lowData is true, gather more traffic before enforcing. |
rolloutSafety.recommendedMode | The safe way to ship: shadow (evaluate, don't enforce), review (gate via approval), or enforce. |
Warning
A negative tokenIssuanceDelta paired with a non-trivial changedOutcomeRate means operations that currently succeed will start being blocked or gated. Coordinate with affected service owners before promoting, and prefer the recommendedMode rather than jumping straight to enforce.
Intent-level dry run#
To confirm a specific case — "would this intent be approved under the new rules?" — run an intent through POST /intent/simulate. It returns the same decision shape as /intent but mints no token and executes nothing.
Dry-run via the CLI
The flat simulate command (alias intent-simulate) posts to /intent/simulate.
Or call the endpoint directly
The response carries the same authorityDecision block as /intent (decision, riskScore, rationale[], gateTrace[]) so you can see which gate produced the outcome — but no authorityDecisionToken and no execution.
Note
POST /intent/simulate dry-runs against the currently active policy, not against an unsaved draft. To preview a draft's effect across many intents, use the impact summary above; use the dry run to spot-check specific intents once the draft is deployed or while you iterate in the console editor.
From simulation to review#
Carry the simulation forward so the reviewer sees what you saw. When you submit the draft for review, pass the simulationRunId that produced the impact summary:
Simulation best practices#
| Practice | Rationale |
|---|---|
| Read the impact summary before every promotion | Sizes the change and surfaces APPROVED → DENIED flips early. |
Respect recommendedMode | shadow/review ship safely; enforce only once the projection is confident. |
Treat lowData: true as a blocker | A projection over too little traffic is not evidence. |
Spot-check with simulate | Confirms the specific intents you care about, gate by gate. |
Attach simulationRunId to the review | Gives the reviewer and the auditor the same evidence you used. |
Next steps#
- Author a Policy — create or refine the draft you are simulating.
- Deploy and Rollback — promote the draft once the impact is acceptable.
- Incident Response — investigate when a deployed change behaves unexpectedly.