A smart garage door opener passed internal QA but failed 3 checklist items before manufacturing. The team debated whether to fix or ship. They fixed. Here’s what the checklist saved:
Checklist failures identified:
1. Network Resilience: “Works offline for critical functions” — FAILED - Testing revealed: Wi-Fi outage = door won’t open/close via physical button - Root cause: Button sent command to cloud, cloud sent to device (required round-trip) - Fix cost: $3,500 (2 days firmware rewrite for local processing) - Cost if shipped: $42,000 (estimated 15% returns × $120 refund × 2,000 units + $8,000 support calls)
2. Installation & Onboarding: “Error messages are specific” — FAILED - Testing revealed: Setup failures showed generic “Error Code 47” with no explanation - User reaction: 8/10 test users gave up and called support - Fix cost: $1,200 (1 day to add specific messages: “Cannot detect Wi-Fi network ‘HomeNet’. Check router is powered on.”) - Cost if shipped: $18,000 (estimating 400 support calls at $45 average handle time)
3. Trust & Security: “Factory reset option is prominent” — FAILED - Testing revealed: Factory reset buried in app under Settings > Advanced > System > Reset (requires 4 taps + scrolling) - User reaction: When selling house, users couldn’t figure out how to deauthorize device from account - Fix cost: $800 (add physical reset button to device) - Cost if shipped: $12,000 (privacy complaints, bad reviews, users factory resetting by cutting power = corrupted state)
Total fix cost: $5,500 Total avoided cost: $72,000
ROI: 13:1 — Every dollar spent on checklist-driven fixes saved $13 in post-launch disasters.
Key lesson: Checklists force teams to test edge cases they’d otherwise skip. The garage door “worked” in ideal conditions (connected, simple setup, no reset needed) but failed in real-world scenarios (network outages, complex home networks, device ownership transfer).