Home/Blog/Playbook
PlaybookJun 10, 2026·8 min read

Human-on-the-loop: where automation should stop

A simple framework for deciding which steps run alone and which always wait for a person to approve.

The question we get on every intro call, in some form, is: "how do I know it won't do something stupid?" It's the right question. The answer isn't "trust the AI" — it's a design decision you make step by step, and there's a simple framework for it.

The one-question test

For each step, ask: what does a wrong call cost, and can I undo it?

Every step in a workflow lands in one of three zones:

Approval should be one tap

The reason most "review steps" fail is that they're heavier than doing the task. If approving a refund means opening three tools, people stop reviewing and start rubber-stamping. We design approvals to arrive with full context — what's requested, why the AI recommends it, what the policy says — so the human decision takes ten seconds and stays a real decision.

Loosen over time, on evidence

Start conservative. Every workflow we ship logs each decision and its outcome, so after a month you have data: this step was approved unchanged 240 times out of 241. That's when you move it from "wait for approval" to "run, then report" — deliberately, based on a track record, not on optimism.

The mistake in both directions

Too little automation and you've built a fancy to-do list; too much and one bad edge case erases months of saved hours. The framework keeps you honest in both directions — and it's why every workflow on our site lists its escalation rules as a feature, not a footnote.

PlaybookAI safetyGuardrailsProcess design
O
The Oryro TeamWe build and run AI automation workflows in production.

Design the guardrails with us.

Book a free call and we'll map your first workflow — approval steps included.

Book a free call