The Autonomy Ladder
Tallgrass leadership wants to move from suggesting to acting. The proposal on the table, for the next two quarters: Job Recap sends itself. No technician review. The summary goes to the homeowner automatically when the job is marked…
Create a free account to upload your work. Your progress saves as a draft until you submit.
What You'll Be Doing
Tallgrass leadership wants to move from suggesting to acting. The proposal on the table, for the next two quarters:
- Job Recap sends itself. No technician review. The summary goes to the homeowner automatically when the job is marked complete.
- Smart Assign assigns. New jobs are placed on the board automatically; the dispatcher can move them.
- Snap Quote quotes. For jobs under $500 on equipment the model identifies with high confidence, the quote is sent to the homeowner without a technician tap.
- Reschedule handles itself. When a technician runs 45+ minutes late, the system texts the affected homeowner, offers two new windows, and rebooks — no human involved.
You are the design lead. The CEO wants one rule the whole company can apply: when does the system act on its own, when does it ask, and when does it refuse to act at all? You are being asked for the ladder, not for four separate features.
What you know:
- Job Recap: 118 monthly “it said something that didn’t happen” tickets against 240,000 recaps. 61% currently sent unedited — so most of them already effectively have no human review, just a tap.
- Smart Assign: 84% first-visit completion when followed vs 79% when overridden. Dispatchers currently accept 12% via the affordance and independently choose the same tech another 31% of the time.
- Snap Quote: 71% correct identification overall, 58% in poor light. 1 in 9 quotes triggers a correction call to the homeowner.
- Reschedule: no model accuracy data — the feature does not exist yet. Late-running jobs happen on about 14% of visits.
- Cost: each autonomous action costs Tallgrass roughly $0.02–$0.09 in inference. Volume is high enough that reversing a bad one costs vastly more than making it — a wrongly sent quote averages $180 in contractor time and goodwill credits, per the support team.
- Legal has signed off on autonomous customer messaging only if every customer-visible artifact carries a clear AI disclosure at first view and there is a documented human-reachable path within one tap.
- The four largest contractor accounts have already asked whether Smart Assign can be turned off.
Write the ladder and design the two states that prove it works.
Constraints to consider
- One rule, applied to all four features. You may set different features at different rungs, but the rule that decides the rung must be the same rule, stated once, and you must apply it to all four.
- Every autonomous customer-visible action requires an AI disclosure at first view and a human-reachable path within one tap. Non-negotiable, no launch-then-fix.
- Reversal must be designed, not assumed. For any action you let the system take alone, you must show what undo looks like to both the internal user and the customer — including the case where the customer has already seen the wrong thing.
- The contractor owns the customer relationship, not Tallgrass. Any autonomous message goes out under the contractor’s brand. A contractor must be able to see and change the setting; you cannot design a Tallgrass-only global switch.
- Thirty minutes. You are producing a ladder plus two annotated states — not four feature designs.
AI Usage Guidance
We expect you to use AI tools. We evaluate how you use them — not whether you use them. Evidence of iteration, redirection, and critical evaluation scores higher than a polished output with no process documentation.
The single highest-signal indicator: your video answer to the mandatory AI question. If you cannot name a specific moment where you redirected AI output, evaluators will assume you did not.
Mandatory AI question for your video: Walk me through one moment where you disagreed with, pushed back on, or redirected what the AI gave you — and what you did instead. Name the specific moment. Explain what the AI produced that didn’t meet the bar, what you did differently, and why.
Communication clarity matters for this role. We assess structure, stakeholder awareness, and ability to simplify complex ideas — not presentation style or accent.
A note on tools and fidelity. We are not scoring visual polish and we are not scoring your tool. Photographed paper sketches score exactly the same as a Figma file. The ladder can be a hand-drawn table. What we score is the rule, the reasoning, and whether the two states you chose actually prove the rule works. Do not spend your thirty minutes on finish.
What You'll Accomplish
Define a single, applicable rule for when a probabilistic system may act without a human
Reason about autonomy using reversibility and consequence rather than accuracy alone
Design a reversal experience for an action a customer has already seen
Meet a legal disclosure and human-access requirement inside a branded third-party relationship
Defend a product-wide design position to a leadership audience that includes a skeptic
How Your Work Will Be Scored
What to Submit
File 1 — Ladder and Two States
Format: no restrictions
Part one is the ladder — your rule stated in one or two sentences, the rungs defined, and all four features placed with a one-line reason each. A hand-drawn table photographed on a phone is fully acceptable. Part two is two annotated states that prove the ladder works. One must be a reversal — the system did something wrong and a human is undoing it. The second is your choice: the disclosure treatment, the contractor’s control surface, the ask-before-acting moment, or the refusal state. Numbered annotations required on both states.
Sign in to upload files
File 2 — README Document
Format: .pdf, .doc, .docx, .rtf, .txt, .md
Three required sections:
- Section A — Written analysis: the rule, why it is the rule, and the argument against it. Apply it explicitly to the two features where it produces an uncomfortable answer, and say why you are living with the discomfort. Address the $180 reversal cost and the accuracy figures with numbers attached. 350–450 words.
- Section B — Reversal, disclosure, and control: (i) your reversal design in words — the trigger, who can pull it, what the customer sees, and what happens when the customer has already acted on the wrong thing; (ii) how you meet the disclosure and one-tap-to-a-human requirement inside the contractor’s brand; (iii) the one action you would refuse to automate at any accuracy level, and why.
- Section C — AI Usage Log (Mandatory): This is not a trick. We want to see how you work with AI — not whether you used it. In a short section of your README, document your AI collaboration process. For each significant interaction with an AI tool, briefly note: what you asked the AI to help with / what it gave you / what you kept, changed, or rejected — and why. Three interactions documented is sufficient. The log does not need to be exhaustive.
Sign in to upload files
File 3 — Video Walkthrough
Format: .mp4, .mov, .webm
Record as MP4 or MOV and upload directly on the Provn platform as a separate file. No ZIP files, no repo links, no third-party video platforms. Cover: (1) your rule in one sentence and the rung each feature lands on, ~60 sec; (2) walk the reversal state, ~2 min; (3) walk your second state and how it meets the disclosure and one-tap requirement, ~90 sec; (4) how you answer the person in the room who thinks autonomy is a mistake, ~60 sec; (5) the mandatory AI question, ~60 sec; (6) the action you would refuse to automate, and why, ~30 sec. Speak naturally, as if briefing your leadership team directly — structural clarity matters, verbal polish does not.
Sign in to upload files
Create a free account to upload your work. Your progress saves as a draft until you submit.
On this page