Design Methodology · Study deck

Ideate, Prototype, and Test

Imagine a team debating three IoT ideas around a whiteboard while the riskiest assumption is still unknown.

Blueprint Bina is your guide for this deck.

thinkingideateprototype
Blueprint Bina, the module guide, in a scene from this chapter.
iotclass.org

After studying this chapter

Learning objectives

You will be able to:

  • Convert How Might We prompts into multiple solution directions before selecting an architecture.
  • Screen ideas with impact, effort, risk, and evidence criteria instead of enthusiasm alone.
  • Choose a prototype fidelity that answers the current learning question without overbuilding.
  • Design Wizard-of-Oz, breadboard, and functional trials for IoT workflows.
iotclass.org

Major section

Prototype the Uncertainty

After Define, the team should have a problem frame, not a chosen architecture.

  • Ideation keeps several paths alive long enough to compare them: no-device service change, local indicator, phone workflow, gateway rule, cloud alert, computer-vision check, predictive model, or custom hardware.
  • The first prototype should expose the biggest unknown without pretending to be the final product.

Key terms

Low fidelity
Low fidelity is acceptable when it protects learning quality.
The ideate-prototype-test loop keeps solution choices tied to evidence instead of opinion.
The ideate-prototype-test loop keeps solution choices tied to evidence instead of opinion.
iotclass.org

Major section

Prototype the Uncertainty (continued)

For IoT, a prototype can target the service path, interface, device behavior, connectivity path, data model, or support workflow.

  • A Figma flow may answer whether a technician understands an escalation.
  • A Wizard-of-Oz test may answer whether an automation pattern is useful.
  • A strong ideation session therefore starts with evidence constraints rather than feature wishes.
iotclass.org

Major section

Prototype the Uncertainty (continued)

An ESP32, RP2040, nRF52840, Raspberry Pi, or Wokwi prototype may answer whether a sensor, radio, or power assumption is credible.

  • For a warehouse safety concept, compare floor markings, wearable haptics, forklift telematics, UWB ranging, camera analytics, and supervisor workflow changes.
  • The point is not to make every option equally likely; it is to keep the team from choosing the most familiar implementation before testing the risk that matters.
  • Low fidelity is acceptable when it protects learning quality.
iotclass.org

Major section

Prototype the Uncertainty (continued)

A storyboard can test whether a user trusts an alert.

  • A clickable Figma flow can test whether the next action is understood.
  • A Node-RED mock connected to Mosquitto can test alert timing.
  • A bench prototype with a BME280, load cell, or ToF sensor can test whether raw readings separate real events from noise.
iotclass.org

Major section

Match Fidelity to the Failure Mode

The right prototype depends on what could make the concept fail.

  • If users cannot classify alert urgency, build a clickable workflow.
  • If the automation does not exist yet, run a Wizard-of-Oz scenario.
  • If the sensor reading is noisy, build a bench rig with known inputs.

Key terms

If the radio path
If the radio path is uncertain, test range, packet loss, RSSI/SNR, retry behavior, and gateway recovery before polishing the app.
iotclass.org

Major section

Match Fidelity to the Failure Mode (continued)

If the radio path is uncertain, test range, packet loss, RSSI/SNR, retry behavior, and gateway recovery before polishing the app.

  • Figma, Framer, Miro, FigJam, Node-RED, Home Assistant, Mosquitto, AWS IoT Core, Azure IoT Hub, Grafana, InfluxDB, Wokwi, PlatformIO, Arduino IDE, Saleae-style logic capture, Joulescope, and Playwright can all be useful.
  • The useful part is the learning boundary: what assumption is being tested, what counts as success, and what the team will change if the result is poor.
  • An alert study should include a true positive, false positive, stale sensor value, delayed notification, escalation to the wrong role, and manual override.
iotclass.org

Major section

Match Fidelity to the Failure Mode (continued)

A provisioning study should include a good QR scan, failed scan, denied Bluetooth permission, wrong Wi-Fi password, gateway offline state, and factory-reset recovery.

  • A field pilot should define who installs the device, what logs are collected, how consent is handled, when support intervenes, and which defects stop the pilot.
  • The winning prototype is the smallest credible artifact that makes the next decision less speculative.
  • Script realistic faults.: Include offline device, stale data, low battery, denied permission, blocked sensor, delayed notification, and manual override states.
iotclass.org

Major section

Tests Need State, Payload, Timing

Even a low-fidelity prototype should model the states that matter.

  • For an alert workflow, use pending, watch, act, escalate, acknowledged, muted, offline, stale, recovered, and support-needed states.
  • These states make user tests and technical tests comparable.
  • A workflow prototype should log task success, alert classification, acknowledgement time, recovery path, accessibility issue, and participant confusion.

Why it matters

That detail prevents a successful demo from hiding an untestable architecture.

iotclass.org

Major section

Tests Need State, Payload, Timing (continued)

A sensing prototype should log signal range, calibration condition, false positive, false negative, latency, power draw, thermal behavior, and environmental sensitivity.

  • If a demo hard-codes cloud credentials into firmware, that is a security and manufacturing finding.
  • If an alert depends on an always-online phone, that is a reliability finding.
  • If a dashboard shows an inferred occupancy state without confidence, freshness, or source, that is a data-quality finding.
iotclass.org

Major section

Tests Need State, Payload, Timing (continued)

The final test record should include the scenario, participant or device context, artifact version, firmware hash if applicable, input data, observed state transitions, payload examples, failures, and decision.

  • A Playwright trace, MQTT capture, Grafana panel, CSV log, video clip, support-ticket note, and participant quote can all belong in the same evidence packet when they answer the same assumption.
  • That packet is what lets the team decide whether to pivot the concept, revise the interaction, change sensor placement, alter the data path, add a support control, or proceed to a higher-fidelity prototype.
  • That detail prevents a successful demo from hiding an untestable architecture.
iotclass.org

Major section

Ideation Techniques

The team needs many interface, device, or service variations quickly.

  • Include local feedback, maintenance, setup, and offline states, not only the app screen.
  • The team is stuck improving an existing product or workflow.
  • Substitute, combine, adapt, modify, put to another use, eliminate, reverse ideas.
  • Alternative ways to change the journey moment.

Why it matters

Useful for IoT because real deployments often lose power, connectivity, access, or trust.

iotclass.org

Major section

Screen Ideas Without Freezing Too Early

Custom hardware is usually not the first test.

  • Impact-effort screening is useful, but IoT teams also need to examine risk and evidence.
  • A high-impact idea can still be a poor first prototype if it hides safety, privacy, support, or manufacturability risk.
  • The riskiest assumption is named and owned.

Why it matters

It changes a decision, reduces effort, improves trust, or prevents harm.

iotclass.org

Major section

Prototype Fidelity

Prototype fidelity is not a maturity badge.

  • That progression connects Prototype fidelity should increase only when the current question requires more realism to the next: Prototype Fidelity check.
  • Integrated behavior across hardware, firmware, network, app, cloud, and support.
  • Adoption, support load, incident handling, training, maintenance, field reliability.
Prototype fidelity should increase only when the current question requires more realism.
Prototype fidelity should increase only when the current question requires more realism.
iotclass.org

Major section

Worked Example: Equipment Alert Redesign

Maintenance technicians need to identify whether a machine alert requires immediate action because repeated non-actionable alerts reduce trust and delay response to real faults.

  • Medium: helps on-site staff.
  • Proceed to technical feasibility only if users can classify the alert, explain the action, and identify who owns the next step.
  • If they cannot, improve the alert language and escalation workflow before adding sensing complexity.
iotclass.org

Major section

Evidence Record

Each test should produce a compact record that can travel with the backlog item.

  • Reading: What was real enough to trust? Against: Offline, stale, low power, clarifies the practical meaning of A compact prototype test record ties participant context, artifact state, observed behavior, decision, and ownership to the backlog item.
  • The user, technical, operational, or trust assumption being tested.
A compact prototype test record ties participant context, artifact state, observed behavior, decision, and ownership to the backlog item.
A compact prototype test record ties participant context, artifact state, observed behavior, decision, and ownership to the backlog item.
iotclass.org

Deck summary

Key takeaways

After Define, the team should have a problem frame, not a chosen architecture.

  • For IoT, a prototype can target the service path, interface, device behavior, connectivity path, data model, or support workflow.
  • An ESP32, RP2040, nRF52840, Raspberry Pi, or Wokwi prototype may answer whether a sensor, radio, or power assumption is credible.
  • A storyboard can test whether a user trusts an alert.
  • The right prototype depends on what could make the concept fail.
iotclass.org

Retrieval practice

Recall check 1 of 3

Blueprint Bina says: answer from memory, then check your reasoning.

Q1A team wants to know whether technicians understand a proposed alert escalation workflow. The automation does not exist yet. What prototype should they use first?

AA production-like PCB and final enclosure before any workflow evidence.
BA Wizard-of-Oz or clickable workflow prototype using realistic alert scenarios.
CA long survey about automation preference without showing the alert flow.
DA full pilot deployment before checking whether technicians understand the flow.
Show answer

Answer: B Prototype fidelity should match the learning question.

iotclass.org

Retrieval practice

Recall check 2 of 3

Blueprint Bina says: answer from memory, then check your reasoning.

Q2During a usability test, users say they like the prototype, but several fail to recover from a simulated network loss. Which evidence should drive the next iteration?

AThe positive preference comments, because users said they liked it.
BThe observed recovery failure, because it affects real use under an IoT constraint.
CThe team's original architecture plan, because changing it would be inconvenient.
DNo evidence; a functional prototype should not be changed after testing starts.
Show answer

Answer: B Observed user behavior in realistic conditions is stronger than general preference comments.

iotclass.org

Retrieval practice

Recall check 3 of 3

Blueprint Bina says: answer from memory, then check your reasoning.

Q3Place each ideate-prototype-test activity where it lives so you can explore options, learn cheaply, and make an evidence-based next-step choice.

AHMW Prompts
BSolution Options
CPrototype Test
DNext Step Choice
Show answer

Answer: A Separate option generation, prototype learning, and iteration choice so you can keep a prototype from being mistaken for a finished or validated product.

Q4Complete the helper that checks whether a prototype test record has enough evidence for a proceed decision:

Afor field in required:
Bfor field in record:
Cwhile required:
Dif record in required:
Show answer

Answer: A The gate requires core test evidence fields, then allows proceed only when the recorded decision is proceed and no unresolved blocker remains.

iotclass.org

Print reference

Answers

Answer key.

  1. B · Prototype fidelity should match the learning question.
  2. B · Observed user behavior in realistic conditions is stronger than general preference comments.
  3. A · Separate option generation, prototype learning, and iteration choice so you can keep a prototype from being mistaken for a finished or validated product.
  4. A · The gate requires core test evidence fields, then allows proceed only when the recorded decision is proceed and no unresolved blocker remains.
iotclass.org