Display orientation adjustment using facial landmark information
AssigneeeBay Inc.
InventorJohn Patrick Edgar Tobin
Life of this patent
Estimating the term…
Abstract
Systems and methods disclosed herein may operate to adjust display orientation of a user device based on facial landmark information. In various embodiments, information identifying and describing a facial landmark of a user may be received via a user device corresponding to the user. Head orientation of the user may be determined based at least in part on the information identifying and describing the facial landmark. A display unit of the user device may be automatically signaled to align display orientation of contents being presented with the head orientation as determined based at least in part on the information identifying and describing the facial landmark.
Claims18
An apparatus comprising:
- a display unit;
- a camera in electronic communication with the display unit;
- and
- at least one memory including program code which when executed by at least one processor cause the apparatus to provide operations comprising:
- receiving, during a preregistration process, information identifying and describing respective facial landmarks of a plurality of users;
- selecting a reference facial landmark from the respective facial landmarks of the plurality of users based at least in part on receiving the information identifying and describing the respective facial landmarks of the plurality of users;
- receiving, based on at least one image captured from the camera, information identifying and describing a facial landmark of a first user;
- determining that the information identifying and describing the facial landmark of the first user is associated with the information identifying and describing the respective facial landmarks of the plurality of users;
- determining an orientation of a display unit of the apparatus based on an angle between the facial landmark of the first user and the display unit of the apparatus;
- determining a facial expression of the first user based on one or more known facial reference points and the information identifying and describing the facial landmark of the first user, the determining of the facial expression being triggered in response to detecting a change in the orientation of the display unit of the apparatus;
- detecting whether the determined facial expression matches a first facial expression stored in the at least one memory during the preregistration process or a second facial expression stored in the at least one memory during the preregistration process, wherein the preregistration process customizes facial recognition for the plurality of users by correlating facial landmark information of respective users to respective user selected facial expressions;
- and
- in response to the determined facial expression matching the first facial expression stored in the at least one memory, activating a first function of the apparatus.
A method comprising:
- receiving, during a preregistration process, information identifying and describing respective facial landmarks of a plurality of users;
- selecting a reference facial landmark from the respective facial landmarks of the plurality of users based at least in part on receiving the information identifying and describing the respective facial landmarks of the plurality of users;
- receiving, based on at least one image captured from a device comprising a camera, information identifying and describing a facial landmark of a first user;
- determining, by at least one processor, that the information identifying and describing the facial landmark of the first user is associated with the information identifying and describing the respective facial landmarks of the plurality of users;
- determining, by the at least one processor, an orientation of a display unit of the device based on an angle between the facial landmark of the first user and the display unit of the device;
- determining, by the at least one processor, a facial expression of the first user based on one or more known facial reference points and the information identifying and describing the facial landmark of the first user, the determining of the facial expression being triggered in response to detecting a change in the orientation of the display unit of the device;
- detecting whether the determined facial expression matches a first facial expression stored in at least one memory during the preregistration process or a second facial expression stored in the at least one memory during the preregistration process, wherein the preregistration process customizes facial recognition for the plurality of users by correlating facial landmark information of respective users to respective user selected facial expressions;
- and
- in response to the determined facial expression matching the first facial expression stored in the at least one memory, activating a first function of the device.
A non-transitory machine-readable storage device storing instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
- receiving, during a preregistration process, information identifying and describing respective facial landmarks of a plurality of users;
- selecting a reference facial landmark from the respective facial landmarks of the plurality of users based at least in part on receiving the information identifying and describing the respective facial landmarks of the plurality of users;
- receiving, based on at least one image captured from a device comprising a camera, information identifying and describing a facial landmark of a first user;
- determining that the information identifying and describing the facial landmark of the first user is associated with the information identifying and describing the respective facial landmarks of the plurality of users;
- determining an orientation of a display unit of the device based on an angle between the facial landmark of the first user and the display unit of the device;
- determining a facial expression of the first user based on one or more known facial reference points and the information identifying and describing the facial landmark of the first user, the determining of the facial expression being triggered in response to detecting a change in the orientation of the display unit of the device;
- detecting whether the determined facial expression matches a first facial expression stored in at least one memory during the preregistration process or a second facial expression stored in the at least one memory during the preregistration process, wherein the preregistration process customizes facial recognition for the plurality of users by correlating facial landmark information of respective users to respective user selected facial expressions;
- and
- in response to the determined facial expression matching the first facial expression stored in the at least one memory, activating a first function of the device.
Dependencies are inferred from the claim text.