US 12,663,864 B2Granted

EMG-based control for interacting with vehicles, and systems and methods of use thereof

AssigneeMeta Platforms Technologies, LLC

InventorsAndrew Scott Brenner, Sean Eric Camacho, Willy Huang, Vicki Chang

Life of this patent

Estimating the term…

Loading patent…

Abstract

Systems and methods for controlling a vehicle system using a wearable device is disclosed. The method includes, while a wrist-wearable device is communicatively coupled with a vehicle system, detecting, via a wrist-wearable device worn by a user, a hand gesture performed by the user. In accordance with a determination that the hand gesture is associated with a vehicle-control action, the method further includes identifying a device of the vehicle system associated with the vehicle-control action, and providing instructions to the vehicle system to cause performance of the vehicle-control action at the device of the vehicle system. The hand gesture is an in-air hand gesture or a surface-contact gesture.

Claims20

Dependent claims

A non-transitory, computer-readable storage medium including instructions that, when executed by one or more processors of a wrist-wearable device, cause the wrist-wearable device to:

while a wrist-wearable device is communicatively coupled with a vehicle system and a head-wearable device:
detect, via one or more biopotential sensors of the wrist-wearable device while it is worn by a user, a hand gesture performed by the user;
identify a field of view of the user based on data from the head-wearable device;
in accordance with a determination that the hand gesture is associated with a vehicle-control action:
identify a device of the vehicle system associated with the vehicle-control action, and
provide instructions to the vehicle system to cause performance of the vehicle-control action at the device of the vehicle system;
and
in accordance with a determination that another device of the vehicle system is within the field of view of the user, provide instructions to the vehicle system to cause performance of the vehicle-control action at the other device of the vehicle system within the field of view of the user.

5 more elements

A method comprising:

while a wrist-wearable device is communicatively coupled with a vehicle system and a head-wearable device:
detecting, via one or more biopotential sensors of the wrist-wearable device while it is worn by a user, a hand gesture performed by the user;
identifying a field of view of the user based on data from the head-wearable device;
in accordance with a determination that the hand gesture is associated with a vehicle-control action:
identifying a device of the vehicle system associated with the vehicle-control action, and
providing instructions to the vehicle system to cause performance of the vehicle-control action at the device of the vehicle system;
and
in accordance with a determination that another device of the vehicle system is within the field of view of the user, provide instructions to the vehicle system to cause performance of the vehicle-control action at the other device of the vehicle system within the field of view of the user.

5 more elements

A wrist-wearable device for controlling a vehicle system using one or more hand gestures, the wrist-wearable device configured to perform or cause performance of:

while a wrist-wearable device is communicatively coupled with a vehicle system and a head-wearable device:
detecting, via one or more biopotential sensors of the wrist-wearable device while it is worn by a user, a hand gesture performed by the user;
identifying a field of view of the user based on data from the head-wearable device;
in accordance with a determination that the hand gesture is associated with a vehicle-control action:
identifying a device of the vehicle system associated with the vehicle-control action, and
providing instructions to the vehicle system to cause performance of the vehicle-control action at the device of the vehicle system;
and
in accordance with a determination that another device of the vehicle system is within the field of view of the user, provide instructions to the vehicle system to cause performance of the vehicle-control action at the other device of the vehicle system within the field of view of the user.

5 more elements

Dependencies are inferred from the claim text.

Facts

Application: 18/604,338Filed 13 Mar 2024 · us provisional application
Priority: 17 Mar 2023
Published: US 2024/0310913 A119 Sep 2024
Granted: 23 Jun 2026
Term ends: Not estimatedThe source records don’t support an estimate.

Classification13 codes

G06F 3/015
Arrangements for interaction with the human body, e.g. for user immersion in virtual reality: input arrangements based on nervous system activity…
B60W 10/06
Including control of propulsion units: including control of combustion engines
B60W 10/30
Conjoint control of vehicle sub-units of different type or different function: including control of auxiliary equipment, e.g. air-conditioning…
B60W 50/14
Interaction between the driver and the control system: means for informing the driver, warning the driver or prompting a driver intervention