Head-mounted display with facial expression detecting capability
AssigneeBinaryvr, Inc.
InventorsJihun Yu, Jungwoon Park
Life of this patent
Estimating the term…
Abstract
Embodiments relate to detecting a user's facial expressions in real-time using a head-mounted display unit that includes a 2D camera (e.g., infrared camera) that capture a user's eye region, and a depth camera or another 2D camera that captures the user's lower facial features including lips, chin and cheek. The images captured by the first and second camera are processed to extract parameters associated with facial expressions. The parameters can be sent or processed so that the user's digital representation including the facial expression can be obtained
Claims19
A head-mounted display unit, comprising:
- a first capturing device configured to capture an upper portion of a user's face including an eye region;
- a second capturing device configured to capture a lower portion of the user's face;
- a display device configured to display images to the user;
- a body configured to mount the first and second capturing devices and the display device;
- and
- a member under the body and configured to mount the second capturing device at a location below the first capturing device.
A method for detecting facial expressions, the method comprising:
- capturing, by a first image capturing device on a main body of a head-mounted display, first images of an upper portion of a user's face including the user's eye region, the main body comprising one or more displays;
- capturing, by a second image capturing device on an extension member extending downwards from the main body, second images of the user including a lower portion of the user's face;
- and
- processing the first images and the second images to extract facial expression parameters representing a facial expression of the user.
A virtual or augmented reality system comprising:
- a head-mounted display unit, comprising:
- a first capturing device configured to capture an upper portion of a user's face including an eye region,
- a second capturing device configured to capture a lower portion of the user's face,
- a display device configured to display images to the user,
- a body configured to mount the first and second capturing devices and the display device, and
- a member under the body and configured to mount the second capturing device at a location below the first capturing device;
- and
- a computing device communicatively coupled to the head-mounted display unit and configured to:
- receive the first and second images from the head-mounted display unit, and
- process the first images and the second images to extract facial expression parameters representing a facial expression of the user.
Dependencies are inferred from the claim text.