Back to results
US 12,591,304 B2Granted
Systems and methods for contextualized interactions with an environment
AssigneeMeta Platforms Technologies, LLC
InventorsFaizan Muhammad, Daniel Wetmore
Life of this patent
Estimating the term…
Abstract
Computerized systems, methods, apparatuses, and computer-readable storage media are provided for generating a 3D map of an environment and/or for utilizing the 3D map to enable a user to control smart devices in the environment and/or to interact with a person in the environment. To generate the 3D map, perform the control, and/or interact with the person, a plurality of neuromuscular sensors may be worn by the user. The sensors may be arranged on a carrier worn by the user and may be configured to sense neuromuscular signals from the user. A camera configured to capture information about the environment may be arranged on the carrier worn by the user. The sensors and the camera provide data to a computer processor coupled to a memory.
Claims20
A system comprising:
- a head-mounted device communicatively coupled with a wearable device that includes a plurality of neuromuscular sensors configured to sense neuromuscular signals from a first user, the plurality of neuromuscular sensors being arranged on the wearable device structured to be worn by the first user;
- at least one camera configured to capture information about a physical environment;
- and
- at least one processor programmed to:
- determine that the first user is present within the physical environment using the information captured by the camera, wherein the first user has control privileges for a first object and a second object within an extended-reality experience associated with the physical environment;
- determine an identity of a second user that is present within the physical environment, wherein the second user has control privileges for the first object and a third object within the extended-reality experience associated with the physical environment;
- detect one or more neuromuscular signals of the first user sensed by the plurality of neuromuscular sensors;
- and
- cause presentation, via the head-mounted device, of a control interface for the first user, selected based on the identity of the second user and in accordance with the first user and the second user both having control privileges for the first object within the extended-reality experience, that allows the first user to interact with the second user via the first object based on the detected neuromuscular signals of the first user.
6 more elements
A wearable electronic device comprising:
- a plurality of neuromuscular sensors configured to sense neuromuscular signals from a first user, the plurality of neuromuscular sensors being arranged on the wearable device structured to be worn by the first user, wherein the wearable electronic device is communicatively coupled with a head-mounted device;
- at least one camera configured to capture information about a physical environment;
- and
- at least one processor programmed to:
- determine that the first user is present within the physical environment using the information captured by the camera, wherein the first user has control privileges for a first object and a second object within an extended-reality experience associated with the physical environment;
- determine an identity of a second user that is present within the environment, wherein the second user has control privileges for the first object and a third object within the extended-reality experience associated with the physical environment;
- detect one or more neuromuscular signals of the first user sensed by the plurality of neuromuscular sensors;
- and
- cause presentation, via the head-mounted device, of a control interface for the first user, selected based on the identity of the second user and in accordance with the first user and the second user both having control privileges for the first object within the extended-reality experience, that allows the first user to interact with the second user via the first object based on the detected neuromuscular signals of the first user.
6 more elements
An apparatus comprising:
- a head-mounted device communicatively coupled with a wearable device that includes a plurality of neuromuscular sensors configured to sense neuromuscular signals from a first user, the plurality of neuromuscular sensors being arranged on the wearable device structured to be worn by the first user;
- at least one camera configured to capture information about a physical environment;
- and
- at least one processor programmed to:
- determine that the first user is present within the physical environment using the information captured by the camera, wherein the first user has control privileges for a first object and a second object within an extended-reality experience associated with the physical environment;
- determine an identity of a second user that is present within the physical environment, wherein the second user has control privileges for the first object and a third object within the extended-reality experience associated with the physical environment;
- detect one or more neuromuscular signals of the first user sensed by the plurality of neuromuscular sensors;
- and
- cause presentation, via the head-mounted device, of a control interface for the first user, selected based on the identity of the second user and in accordance with the first user and the second user both having control privileges for the first object within the extended-reality experience, that allows the first user to interact with the second user via the first object based on the detected neuromuscular signals of the first user.
6 more elements
Dependencies are inferred from the claim text.