UX Design · Study deck

User Research Fundamentals for IoT

Start with a person doing a real task, not with a feature list.

UX Uma is your guide for this deck.

user-researchevidenceassumptions
UX Uma, the module guide, in a scene from this chapter.
iotclass.org

After studying this chapter

Learning objectives

You will be able to:

  • Explain: A failed visitor invite might involve OAuth token expiry, push-notification permission, BLE commissioning state, a Matter fabric role, an MQTT retained message, a revoked credential, or a support workflow that cannot see device state.
  • Explain: A setup screen can look clear in a conference room but fail on a porch at night, beside a metal equipment cabinet, in a shared apartment, or during a maintenance visit with weak connectivity.
  • Explain: A setup study may need QR-scan time, BLE advertisement discovery, pairing error, permission denial, gateway reachability, device identity, account role, and final user-visible state.
iotclass.org

Major section

Check Your User-Research Evidence · IoT Research Beyond Screens

IoT user research studies people, places, devices, services, and support paths together.

  • A setup screen can look clear in a conference room but fail on a porch at night, beside a metal equipment cabinet, in a shared apartment, or during a maintenance visit with weak connectivity.

Why it matters

A smart-lock team might learn that residents understand the app invitation but visitors still wait outside because the reader, push notification, and support script describe different states.

Evidence-first IoT user research loops from a design decision to assumptions, observation, interpretation, requirements, and retest triggers.
Evidence-first IoT user research loops from a design decision to assumptions, observation, interpretation, requirements, and retest triggers.
iotclass.org

Major section

Field Observation with Device Logs

A useful research plan pairs human observation with system traces.

  • Field notes may show that a resident taps "unlock" repeatedly, while device logs show BLE reconnect delays, gateway timeouts, or a cloud authorization failure.
  • Neither source is enough by itself.
  • Contextual inquiry can reveal installation and maintenance problems.

Why it matters

Instrument the path.: Capture firmware version, battery voltage, RSSI, gateway status, timestamps, app event names, permission state, and error codes where privacy rules allow.

iotclass.org

Major section

Field Observation with Device Logs (continued)

Observe the task.: Watch what users see, touch, wait for, override, ignore, ask another person to do, or abandon.

  • Diary studies can reveal long-term trust and alert fatigue.
  • Usability tests can check setup, permission, and recovery flows.
  • The practitioner discipline is to stop research from becoming a separate UX artifact.
iotclass.org

Major section

Field Observation with Device Logs (continued)

If the decision is "which alert deserves escalation?", observe the role that can act, the competing tasks, and the operating consequence of a false alarm or missed alarm.

  • Separate sources.: Keep observation, device telemetry, support history, interpretation, and design action distinct so the team knows what is known and what is inferred.
  • For small teams, a lightweight evidence record is enough: decision, role, context, observation, supporting trace, interpretation, requirement, evidence boundary, owner, and change condition.
  • Engineering should see which state labels, logs, error codes, and fallback paths are required.
  • Product should see which decision is supported and which remains unproven.
iotclass.org

Major section

Research Findings Need Boundaries

Technical traces should be designed for research before field trials begin.

  • IoT research becomes actionable when each finding names the system boundary behind the behavior.
  • The trace must be scoped to the research question.
  • An alarm study may need sensor value, threshold rule, sample age, acknowledgement time, notification delivery state, escalation target, and operator action.

Why it matters

Boundaries also prevent overclaiming.

iotclass.org

Major section

Research Findings Need Boundaries (continued)

A maintenance study may need battery voltage, enclosure access, calibration date, firmware build, and ticket resolution path.

  • A failed visitor invite might involve OAuth token expiry, push-notification permission, BLE commissioning state, a Matter fabric role, an MQTT retained message, a revoked credential, or a support workflow that cannot see device state.
  • A LoRaWAN pilot with strong RSSI may not prove behavior in a basement.
  • Retest triggers should be as explicit as release criteria.
iotclass.org

Major section

Research Findings Need Boundaries (continued)

Boundaries also prevent overclaiming.

  • A setup study may need QR-scan time, BLE advertisement discovery, pairing error, permission denial, gateway reachability, device identity, account role, and final user-visible state.
  • A field note from one apartment building may support shared-entry wording for residents and visitors, but not enterprise badge policy, offline master-key behavior, or emergency egress.
  • Each research record should name the technology, role, environment, and failure class it does and does not cover.
iotclass.org

Major section

Research Findings Need Boundaries (continued)

A Matter setup test with one phone model may not prove Android permission copy, iOS local-network prompts, or multi-admin transfer.

  • Timing:: Align app, device, gateway, and cloud clocks well enough to reconstruct setup, command, alert, and recovery sequences.
  • Privacy:: Collect the minimum data needed, separate personal identity from device diagnostics where possible, and explain what is logged.
  • Implementation teams can support better research by exposing stable event names, correlation ids, state-machine transitions, error taxonomies, and support-visible summaries before the pilot.
iotclass.org

Major section

Field Evidence to Decisions · Why User Research Matters

Observe the task where the physical, social, and technical constraints are visible.

  • Translate the finding into a checkable requirement.: The requirement should name the state, role, context, and acceptance condition.
  • IoT design often fails when a technically correct system does not match the user's real situation.
  • A setup flow works in the lab but fails on a dim porch with weak connectivity.
iotclass.org

Major section

Evidence-First Research Loop · Evidence to Requirements Chain

Example: "The setup flow must distinguish device offline, app permission denied, and invite pending before field pilot review.".

  • Observation: What was seen, heard, logged, or recorded.
  • Interpretation: What the team thinks the observation means.
  • Example: "Participants may not trust the app state until the device state is visible.".

Why it matters

Example: "A clearer app status message will reduce setup retries.".

iotclass.org

Major section

The Curse of Knowledge · Stated Preference and Revealed Behavior

The curse of knowledge happens when experts forget what it is like not to know what they know.

  • "What would this screen, alert, or device state mean to someone seeing it for the first time while doing the real task?".
  • Stated preference is not useless.

Why it matters

But for design decisions, observed behavior is often stronger because it shows what people do under real constraints.

Stated preferences compared with revealed behavior.
Stated preferences compared with revealed behavior.
iotclass.org

Major section

Context Changes the Design · Users and Affected Roles

The same user may behave differently depending on context.

  • Physical: space, lighting, noise, weather, reach, mounting, cleaning, power, and placement.
  • Social: alone, shared household, workplace, visitor, caregiver, technician, manager, or support agent.
  • Temporal: routine, time pressure, emergency, night, shift work, seasonal use, or long-term maintenance.
iotclass.org

Major section

From Research Question to Evidence · Write Better Research Questions

Together,: Role and: Interpretation frame the from research question to evidence claim: iot user research evidence record separating question, role, context, observation, interpretation, requirement, validation, and change condition.

  • "Do users like the product?".
  • "Would people use automation?".

Why it matters

"When does a comfort automation rule need to suggest, ask, act with override, or avoid acting because the consequence or privacy risk is too high?".

IoT user research evidence record separating question, role, context, observation, interpretation, requirement, validation, and change condition.
IoT user research evidence record separating question, role, context, observation, interpretation, requirement, validation, and change condition.
iotclass.org

Major section

Incremental Examples

A first research pass for a home leak sensor can observe three things: where people place the sensor, how they test reachability, and what they think the LED or app status means.

  • The team can pair field notes with app events, Wi-Fi RSSI, battery state, firmware version, and the last successful alert timestamp.
  • A shared-entry product needs research across residents, visitors, installers, and support staff.
  • The requirement should separate what residents can fix from what support must own.
iotclass.org

Major section

Incremental Examples (continued)

The design decision might be whether setup should show "reachable here", "move closer to gateway", or "test with water" before the device is trusted.

  • Observations should cover pending invites, revoked credentials, denied phone permissions, reader offline state, and support handoff.
  • BLE or NFC credential state, reader firmware, app event names, push-notification permission, and support tags can explain why a person repeats an invite or calls support.
  • A cold-chain monitoring study may involve operators, quality staff, maintenance technicians, and external auditors.
iotclass.org

Major section

Research Fundamentals Checklist · Common Defects

Observation drift: writing interpretation as if it were observed fact.

  • Designing for ourselves: assuming the team's knowledge, devices, habits, and patience match the user's.
  • Context omission: testing in clean conditions when real use is noisy, rushed, shared, dark, wet, mobile, or interrupted.
  • Happy-path evidence: ignoring failure, maintenance, transfer, support, and removal.
iotclass.org

Major section

Try It Now · Separate Research Claims

"Users ignored the maintenance alert, so they need a bigger red banner.".

  • "Do users like alerts?".
  • A stronger question should name the role, context, alert state, decision to be made, evidence source, and action the team may take.
  • The observation should say what was seen.
iotclass.org

Deck summary

Key takeaways

IoT user research studies people, places, devices, services, and support paths together.

  • A useful research plan pairs human observation with system traces.
  • Observe the task.: Watch what users see, touch, wait for, override, ignore, ask another person to do, or abandon.
  • If the decision is "which alert deserves escalation?", observe the role that can act, the competing tasks, and the operating consequence of a false alarm or missed alarm.
  • Technical traces should be designed for research before field trials begin.
iotclass.org

Retrieval practice

Recall check 1 of 2

UX Uma says: answer from memory, then check your reasoning.

Q1A team is deciding how a shared-entry app should explain failed visitor invites after observing residents, visitors, and support staff. Which research record is strong enough to guide the design?

ADesign decision, roles, field context, observations, interpretation, evidence boundary, requirement, validation plan, owner, and change condition.
BA polished invite screen plus a note that the interaction follows familiar mobile sharing patterns.
CA feature list showing invite creation, credential status, support links, push alerts, and account settings.
DA single demo where one invite succeeds while the reader is online, phone permissions are granted, and the visitor is already nearby.
Show answer

Answer: A A reviewable IoT user-research record ties the design decision to roles, context, observations, interpretation, evidence boundary, requirement, validation, owner, and change condition before the finding is trusted.

iotclass.org

Retrieval practice

Recall check 2 of 2

UX Uma says: answer from memory, then check your reasoning.

Q2A team says users want a detailed sensor dashboard because interview participants said it sounded useful. In field observation, people only check whether the device is ready, stale, offline, or needs action. What should the team conclude?

AThe stated preference is enough evidence to prioritize the dashboard.
BObserved behavior suggests the primary requirement is actionable state clarity
CPrioritize the dashboard because interviews can reveal needs that were not visible during a short field visit.
DReplace persistent state labels with an on-demand detailed report.
Show answer

Answer: B User research fundamentals require separating stated preference from observed behavior and turning evidence into testable requirements.

iotclass.org

Print reference

Answers

Answer key.

  1. A · A reviewable IoT user-research record ties the design decision to roles, context, observations, interpretation, evidence boundary, requirement, validation, owner, and change condition before the finding is trusted.
  2. B · User research fundamentals require separating stated preference from observed behavior and turning evidence into testable requirements.
iotclass.org