Three-Modality Light Controller
Three-Modality Light Controller
animation
ux-design
multimodal
NoteTry It Yourself
Hands-on exercises to explore multimodal interaction:
Three-Modality Light Controller
Create a smart light control system supporting voice, touch, and physical inputs:
Use Wokwi ESP32 simulator with:. Physical button (GPIO pin) for on/off toggle. Serial Monitor for voice-like text commands (“lights on”, “dim to 50%”). Web dashboard with slider for touch control. Implement state synchronization: any input method updates all outputs. Add multimodal feedback: LED state + Serial confirmation + web UI update.
What to observe: Notice how each modality has different latency (physical button <10 ms, serial “voice” ~100 ms, web slider ~200 ms with network). Test which modality feels most responsive in different scenarios.