Systems and methods for facial expression tracking
AssigneeMeta Platforms Technologies, LLC
InventorsManoj Bikumandla, Chao Han
Life of this patent
Estimating the term…
Abstract
A facial tracking device including an illuminator and a photon detector. The illuminator configured to project a light toward a first portion of a head of a user and the photon detector configured to detect light reflected from a second portion of the head of the user. The facial tracking device further including a processor that is connected to the illuminator and photon detector and configured to cause the illuminator to project the light toward the head of the user, receive information from the photon detector, and determine a facial expression of the user.
Claims21
1-20. (canceled)
A head wearable display (HWD) comprising:
- an element configured to be worn on a head of a user;
- an illuminator disposed with the element and configured to emit light toward at least a portion of the head;
- a plurality of photon detectors disposed with the element and configured to receive light reflected from at least a second portion of the head;
- a winner take all circuit configured to receive electric signals from the photon detectors and provide a signal having an ultimate characteristic;
- and
- one or more processors coupled to a non-transitory computer-readable storage medium having instructions encoded thereon that, when executed by the one or more processors, cause the one or more processors to:
- determine a facial expression of the user based at least on the information derived from the signal having the ultimate characteristic .
A facial tracking device comprising:
- an illuminator configured to emit light toward at least a portion of a face of a user;
- a plurality of photon detectors configured to receive light reflected from the face;
- a winner take all circuit configured to receive electric signals from the photon detectors and provide a signal having an ultimate characteristic and
- a processor configured to determine a facial expression of the user based at least on the information derived from the signal having the ultimate characteristic.
The facial tracking device of claim 8, wherein characteristics of the light of the illuminator are spatially encoded corresponding to the portion of the face of the user.
A method of tracking a facial expression of a user comprising:
- projecting light using an illuminator of a facial tracking system toward a face of a user;
- receiving electric signals from photon detectors, via the facial tracking system, related to the light reflected from the face;
- using a winner take all circuit to receive electric signals from the photon detectors and provide a signal having an ultimate characteristic;
- and
- determining, via the facial tracking system, a facial expression of the face in response to the signal having the ultimate characteristic.
Dependencies are inferred from the claim text.