Multi-device gesture control

An electronic device, comprising:

• a first sensor;
• a second sensor;
• memory storing:
• one or more gesture-control elements for each of a plurality of devices;
• and
• a machine learning model trained to recognize each of a predetermined plurality of gestures based on input sensor data from at least the second sensor;
• and
• one or more processors configured to:
• determine that the electronic device is within a predetermined range of the plurality of devices;
• receive a selection, based on data from at least the first sensor of the electronic device, of one of the plurality of devices for gesture control;
• obtain, based on the selection, the one or more gesture-control elements for the one of the plurality of devices;
• provide, for display, one or more gesture-control icons, respectively, for the one or more gesture-control elements for the one of the plurality of devices;
• receive a selection of one of the one or more gesture-control icons corresponding to one of the one or more gesture-control elements;
• receive sensor data from at least the second sensor;
• recognize one of the predetermined plurality of gestures by providing the received sensor data to the machine learning model;
• and
• control the one of the plurality of devices by applying the recognized one of the predetermined plurality of gestures to the one of the one or more gesture-control elements corresponding to the selected one of the one or more gesture-control icons.

A non-transitory machine-readable medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:

• determining, by an electronic device storing one or more gesture-control elements for each of a plurality of devices, that the electronic device is within a predetermined range of the plurality of devices;
• receiving a selection, based on data from at least a first sensor of the electronic device, of one of the plurality of devices for gesture control;
• obtaining, based on the selection, the one or more gesture-control elements for the one of the plurality of devices;
• providing, for display, one or more gesture-control icons, respectively, for the one or more gesture-control elements for the one of the plurality of devices;
• receiving, by the electronic device, a selection of one of the one or more gesture-control icons corresponding to one of the one or more gesture-control elements;
• receiving sensor data from at least a second sensor of the electronic device;
• recognizing one of a predetermined plurality of gestures by providing the received sensor data to a machine learning model trained to recognize each of the predetermined plurality of gestures based on input sensor data from at least the second sensor;
• and
• controlling the one of the plurality of devices by applying the recognized one of the predetermined plurality of gestures to the one of the one or more gesture-control elements corresponding to the selected one of the one or more gesture-control icons.