Design calibrated trust: disclosure, citations, uncertainty, override, accessibility and a safe non-AI fallback.
The experience designer decides what people see, read, hear and do. With AI (artificial intelligence) in a product, that includes a new job: designing calibrated trust. Users should trust the output as much as the evidence allows, no more and no less. The designer makes the AI's involvement, its sources, its uncertainty and the way out visible, and proves with real users that it works.
This seat also uses AI in its own work: synthesis, copy variants, prototypes. The same data rules apply. Research notes about real people are classified data. Counts and thresholds on this page are illustrative.
1. At a glance
Item
For the experience designer
Mandate
Design the interaction, content and service so users act correctly, including when the AI is wrong, unsure or switched off
Stage 1: generate copy variants for an internal, non-confidential screen, then choose and edit one yourself
Biggest failure mode
A fluent AI answer with no source, no uncertainty cue and no fallback, tested only on the happy path. That design invites automation bias
Line: 1st line · Family: Shape · Variants: UX (user experience) design, service design, content design, conversational design, accessibility
Variant
What differs
UX designer
Screens and flows. Owns where the AI disclosure, citation and correction controls sit, and what the non-AI path looks like
Service designer
The whole journey across channels and staff. Owns hand-offs between the AI step, the person and the back office, and the fallback procedure's place in the journey
Content designer
Words. Owns labels, disclosure text, error and abstention messages; customer-facing wording goes to compliance
Conversational designer
Turn-by-turn behavior of an assistant. Owns the conversation spec: scope, clarifying questions, abstention, escalation to a person
Accessibility specialist
Owns accessibility acceptance criteria and testing with assistive technology. Accessibility is a release criterion, verified by QA (quality assurance), not a preference
2. Your journey: first steps to fully adopted
The designer moves from AI-drafted copy on internal screens to shared, tested trust patterns; each stage adds controls and evidence, never the right for AI to decide what a user reads.
Start here: your first steps
Confirm the research data rules with privacy before any tool sees participant notes.
Generate copy variants for one internal, non-confidential screen, then choose and edit one yourself.
Mask research notes, then cluster them with the approved assistant and check each theme against the raw notes.
Load the content style guide and glossary into a reviewed team prompt ("due date", never "payment date").
Fully adopted: how the work runs
Moment in the work
Before AI
Fully adopted (Stage 4–5)
Decision that stays human
Research
Session notes synthesized by hand
Masked notes are clustered by the assistant; you check each theme; stress, edge and accessibility sessions run with real users
The research sample, and whether real users understood
Design spec
Each screen designed from scratch
Shared trust patterns (citation card, abstention message, fallback banner) from the design system; a mock built from the criteria arrives in the front-loaded pack
What the customer reads; compliance approves disclosure wording
Test
Happy-path usability tests only
An agent drafts conversation test turns and accessibility checks; the specialist tests with assistive technology
The accessibility pass; the manual test is never skipped
Release
Design handed off and drifts after build
Specs are versioned with the prompt and model version they were tested with
Whether to release after a model or corpus change, once test turns are re-run
Operation
Complaints arrive late and unlinked
Corrections and near misses from real use feed the design review
Whether a trust pattern misleads users and must change or retire
What changes for the organization
Before
After
AI answers look more certain than the evidence allows
Every AI answer shows its source, its limits and a way out
Accessibility is checked late, if at all
Accessibility is a release criterion, tested with assistive technology
Work stops when the AI is off
Every AI feature has a designed and tested non-AI path
In any organization
Who covers it: in a small or unregulated organization, the product owner or a front-end developer does this design work; the answer card checklist still applies.
What scales: research operations and a design system board can shrink to a shared document and a peer review. What never drops: no participant or customer data in unapproved tools, a human decides what customers read, and a visible fallback when the AI is off.
3. Your decisions
Decision relationships on this site: owner or approver, independent validator or challenger, consulted control partner, evidence recipient, notified.
Decision
You own / advise / challenge
Inputs
Escalation
Cannot be delegated
How AI involvement is disclosed
Own the design; compliance is a consulted control partner for wording
Intended use, risk tier, obligations
Product owner, compliance
Yes
How sources and uncertainty are shown
Own
Retrieval design, evaluation results
AI engineer, product owner
Yes
Correction, override and escalation controls
Own the design; the operational owner owns the procedure behind them
Shares trust patterns (citation card, abstention message, fallback banner) in the design system and asset catalog
Owner, version, research evidence, limits
Pattern entries
Contributor; design system owner approves
Research finds a pattern misleads users
Stays human at Stage 5: choosing the research sample, judging whether real users understood the uncertainty cue, and deciding what a customer reads. Synthetic users do not replace real ones.
6. Priority scenarios
Scenario
Value
Risk tier
Stage
First step
Do not use AI when…
Copy variants for internal screens
Faster content work
Low
1
Generate, choose, edit
The text is a regulated disclosure
Research synthesis
Faster themes
Medium (participant data)
1 to 2
Mask notes; cluster; check each theme against raw notes
Notes are unmasked or consent does not cover the tool
Designing an assistant's answer card
Calibrated trust
Same tier as the feature
Any
Show answer, source, uncertainty, correction, fallback
The feature has no fallback yet; design that first
Conversation spec and test turns
Fewer surprises in use
Same tier as the feature
3
Agent drafts turns from the spec; you add stress and edge turns
The spec does not define scope and abstention
Accessibility checks
Release-ready accessibility
Medium
3
Agent drafts checks; specialist tests with assistive technology
You would skip the manual test because the draft passed
Customer reminder wording
Clear reminders
High if generated live
1
Draft variants offline; compliance approves one fixed template
Live generation per customer is proposed (find use cases)
7. The due-date ask from your seat
The designer has a material artifact: how the due date and cutoff read on four channels. No model is in the runtime path, so the design job is clarity, not AI trust.
Step
Input received
Your decision
Output and evidence
Recipient
Display spec
Stories US-1 to US-5 (user stories); the temporal decision
The due date shows as "Nov 16, 2026" everywhere; the cutoff shows as "2:00 PM PT" (PT is Pacific time) with the zone named
Display spec per channel
Developer, QA engineer
Fallback label
Missing-zone rule
Label reads "based on your state of residence" next to the cutoff, with a link to set a zone
Content spec line; criterion US-4
Business analyst, compliance (wording)
Accessibility
Accessibility criteria
Screen readers announce "2:00 PM Pacific time", not "PT"; the date is read as a date
Accessibility criteria; assistive-technology test result
QA engineer (verifies)
Reminder text
Notification template
One fixed template; variants drafted with AI offline; compliance approves the final
Approved template, version noted
Release manager (evidence)
Research check
Five usability sessions (illustrative), including a customer with a missing zone
Whether people read the cutoff correctly
Findings note, masked
Product owner
Policy assistant · designing calibrated trust
The companion policy assistant is where the AI interaction design is material. Staff must check the cited section before they relay a consequential answer, so the design must make that check easy and expected.
Element
Design
Why
Disclosure
Header: "AI answer from approved policy. Check the cited section before you relay it"
Says what it is and what the user must do
Citation
Document, version and section, one click to the passage, passage highlighted
Verification takes seconds, so staff actually do it
Uncertainty
No confidence percentage. Ambiguous questions get a clarifying question
Numbers invite false precision
Abstention
"I can't answer that from approved policy. Ask your supervisor." plus the escalation route
A clear way out, not a dead end
Correction
"This answer is wrong or unclear" control, one tap, optional note
Feeds near-miss reporting
Fallback
When the assistant is off: banner with the procedure manual and the supervisor line
Accessibility criteria and test results (produced)
Test evidence store
Accessibility specialist, QA engineer
Research findings (produced, masked)
Research repository under the research data rules
Experience designer
Consent records (consumed)
Research consent system
Research operations
Approved wording (consumed)
Content repository
Compliance
10. Skills and learning path
Level
You can…
Practice
Foundation
Pass acceptable use; mask research data; explain automation bias in one sentence
Rewrite the due-date labels for a screen reader
Practitioner
Design an answer card with citation, uncertainty, correction and fallback; run stress sessions
Lab L6 (policy assistant): design its answer card and abstention message
Advanced
Write a conversation spec with test turns; publish trust patterns with research evidence
Lab L4 with QA, turning the spec into an evaluation set; the templates prompt card
11. Measures and incentives
Metric
Definition
Anti-gaming note
Verification rate
Share of consequential answers where staff opened the cited passage
Opening is not reading; pair with spot checks
Correct relay rate
In sessions, share of answers relayed correctly, including abstentions
Include stress and assistive-technology sessions
Correction use
Corrections filed per thousand answers
A drop may mean the control is hard to find
Accessibility defects at release
Open accessibility defects in released AI features
Severity-weighted; zero high severity
Fallback findability
Time to reach the non-AI path in a session
Measure with the assistant switched off
12. Cost, capacity and workforce
Item
Note for the experience designer
Research time
AI features need more research, not less: stress, edge and accessibility sessions. Budget them in the plan
Prototype speed
AI prototypes are cheap. Cheap prototypes make it easy to skip research; do not
Role shift
Conversation and content design become product artifacts that change with each model. Keep them versioned
13. Anti-patterns and stop conditions
Anti-pattern or trigger
Why it hurts
What you do
Confidence percentage
Users read it as a guarantee
Show the source and a clear abstention instead
Hidden AI
Users cannot calibrate trust
Disclose it where the answer appears
Happy-path testing only
Misuse shows up in production
Add stress, edge and accessibility sessions
Synthetic users as evidence
No real behavior
Use them only to draft scripts
Participant data in a prompt
Privacy breach
Stop; report the near miss; mask first
Model or corpus change
Answers change shape; the design may now mislead
Re-run the conversation test turns before release
14. Action kit and 30/60/90
## Experience designer · AI answer card checklist · v1
Disclosure: says it is AI and what the user must do next.
Source: document, version, section; one action to open the passage.
Uncertainty: clarifying question or abstention, never a confidence number.
Abstention: plain message plus the escalation route.
Correction: one-step "wrong or unclear" control that files a report.
Fallback: the non-AI path when the assistant is off; tested with it off.
Accessibility: works with a screen reader and keyboard only; criteria written.
Research: includes stressful context, edge cases and assistive technology.
Versioned: spec linked to the prompt and model version it was tested with.
Questions to ask your enablement lead:
Which tools are approved for research synthesis, and what masking is required first?
Where do the shared trust patterns live, and who approves a new one?
Who tells me when the model or retrieval corpus behind my design changes?
Window
Goals
Done when
First 30 days
Stage 0 and 1: research data rules; copy variants on internal screens
Acceptable use attested; masking routine in use
Days 31 to 60
Design one AI answer card with the checklist
Card reviewed by the product owner and compliance; fallback path designed
Days 61 to 90
Run stress and accessibility sessions; publish one trust pattern
Findings recorded; pattern in the catalog with evidence