Back to results
US 12,574,627 B2Granted
Smart cameras enabled by assistant systems
AssigneeMeta Platforms Technologies, LLC
InventorsLisa Xiaoyi Huang, Eric Xiao, Nicholas Michael Andrew Benson, Yating Sheng, Zijian He
Life of this patent
Estimating the term…
Abstract
In one embodiment, a method includes accessing sensory data captured by cameras, identifying people in a field of view of the cameras based on facial recognition of the sensory data, detecting actions of one or more of the people based on the sensory data, generating media files with each being associated with one or more of a recording of at least one of the people or at least one of the determined actions, and sending instructions for presenting one or more of the media files to a client system.
Claims20
A method comprising, by one or more computing systems:
- accessing sensory data comprising visual data captured by one or more cameras of head-mounted display configured to be worn by a user;
- using the visual data, detecting at least two people in a field of view of the one or more cameras and further detecting facial expressions associated with each of the at least two people;
- determining, using one or more machine-learning models, whether each respective person of the at least two people is a point of interest of the visual data;
- identifying a person of interest from the at least two people as a point of interest of the visual data;
- in accordance with determining that a first privacy setting is associated with the person of interest, the first privacy setting indicating that the user is allowed to identify the person of interest within a respective media sharing application:
- adjusting capture of the visual data based at least in part on the person of interest;
- and
- generating a media file comprising a recording of the person of interest;
- identifying another person of interest from the at least two people as another point of interest of the visual data;
- and
- in accordance with determining that a second privacy setting is associated with the other person of interest, the second privacy setting indicating that the user is not allowed to identify the other person of interest within the respective media sharing application:
- forgoing generating any media files comprising any recordings of the other person of interest.
9 more elements
One or more computer-readable non-transitory non-volatile storage media embodying software that is operable when executed to:
- access sensory data comprising visual data captured by one or more cameras of a head-mounted display configured to be worn by a user;
- using the visual data, detect at least two people in a field of view of the one or more
- cameras and further detect facial expressions associated with each of the at least two people;
- determine, using one or more machine-learning models, whether each respective person of the at least two people is a point of interest of the visual data;
- identify a person of interest from the at least two people as a point of interest of the visual data;
- in accordance with determining that a first privacy setting is associated with the person of interest, the first privacy setting indicating that the user is allowed to identify the person of interest within a respective media sharing application:
- adjust capture of the visual data based at least in part on the person of interest;
- and
- generate a media file comprising a recording of the person of interest;
- identify another person of interest from the at least two people as another point of interest of the visual data;
- and
- in accordance with determining that a second privacy setting is associated with the other person of interest, the second privacy setting indicating that the user is not allowed to identify the other person of interest within the respective media sharing application:
- forgoing generating any media files comprising any recordings of the other person of interest.
10 more elements
A system comprising:
- one or more processors;
- and
- a non-transitory non-volatile memory coupled to the processors comprising instructions executable by the processors, the processors operable when executing the instructions to:
- access sensory data comprising visual data captured by one or more cameras of a head-mounted display configured to be worn by a user;
- using the visual data, detect at least two people in a field of view of the one or more cameras and further detect facial expressions associated with each of the at least two people;
- determine, using one or more machine-learning models, whether each respective person of the at least two people is a point of interest of the visual data;
- identify a person of interest from the at least two people as a point of interest of the visual data;
- in accordance with determining that a first privacy setting is associated with the person of interest, the first privacy setting indicating that the user is allowed to identify the person of interest within a respective media sharing application:
- adjust capture of the visual data based at least in part on the person of interest;
- and
- generate a media file comprising a recording of the person of interest;
- identify another person of interest from the at least two people as another point of interest of the visual data;
- and
- in accordance with determining that a second privacy setting is associated with the other person of interest, the second privacy setting indicating that the user is not allowed to identify the other person of interest within the respective media sharing application:
- forgoing generating any media files comprising any recordings of the other person of interest.
12 more elements
Dependencies are inferred from the claim text.