Voice Recognition Success Rate Analysis

Voice Recognition Success Rate Analysis

animation
ux-design
Try Change Successful commands: to 742.
Observe Watch Current Success Rate after you press Calculate.
Explain Explain why the 85% success target is a design threshold.

Technical boundaries. The example is synthetic, and the 85% target is not a mathematical cutoff from two-failure probability. A paired significance test requires each resident's before-and-after outcomes.

TipPutting Numbers to It

How do we calculate voice recognition success rate, and what does the example’s 85% design target mean?

Success rate formula (from 2,847 commands over 4 weeks):

Success rate=Commands executed correctlyTotal commands attempted×100% \text{Success rate} = \frac{\text{Commands executed correctly}}{\text{Total commands attempted}} \times 100\%

For the “Temperature adjust” category:

Success rate=742876×100%=84.7% \text{Success rate} = \frac{742}{876} \times 100\% = 84.7\%

Interactive Calculator: Voice Recognition Success Rate Analysis

A paired significance test requires each resident’s before-and-after outcomes. The two marginal confidence intervals do not determine a p-value.

Illustrative success rate before/after: 79.3% / 91.2%; compute uncertainty only from resident-level outcomes or a prespecified clustered analysis.

Improvement: 11.9 percentage points

Two-failure probability examples:

At 85% success, probability of 2 consecutive failures:

P(2 failures)=(1−0.85)2=0.0225=2.25% P(\text{2 failures}) = (1 - 0.85)^2 = 0.0225 = 2.25\%

At 79% success (below the example’s 85% design target):

P(2 failures)=(1−0.79)2=0.0441=4.41% P(\text{2 failures}) = (1 - 0.79)^2 = 0.0441 = 4.41\%

In this synthetic worked example, assume that 78% of users encountering 2+ consecutive failures within 5 minutes abandon voice and revert to physical controls.

Cost-benefit of the fix:

  • Fix cost: $1,900 (38 developer hours)
  • Value: (91.2−79.3)×87 residents×12.3 commands/week=11.9%×1,070=127(91.2 - 79.3) \times 87 \text{ residents} \times 12.3 \text{ commands/week} = 11.9\% \times 1,070 = 127 additional successful commands per week
  • Avoided support calls: 127 × 15% frustration rate × $28/call = $533/week savings

ROI: $533/week × 52 weeks = $27,716 annual savings vs. $1,900 fix cost = 15× return

Key insight: The 85% success target is a design threshold in this example, not a mathematical cutoff derived from two-failure probability. Validate adoption against observed user outcomes.

Assumed resident-satisfaction relationships in this example:

Key insight: The 85% success rate is an example design target; assess adoption against observed user outcomes rather than treating it as a minimum. :::

Back to the chapter