HowToYouDo is aimed to help users learn how to activate home appliances using their smart phones and a new kind of “talkback” from the appliance.

How does it work? It makes use of custom electronics and novel mobile device features. Using an NFC (Near Field Communication) sensor, the phone identifies the home appliance and presents a series of questions and instructions to the user. After selecting the required action, the phone senses each physical action performed on the appliance’s buttons and controls, and presents either the next required step for completing the task, or corrective feedback based on the user’s real-world activity.