# US 10,523,852 B2 · Wearable inward-facing camera utilizing the Scheimpflug principle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,523,852 B2
- Document ID: US10523852B2
- Status: Granted
- Kind: B2
- Application number: 15/722,434
- Filed: 2017-10-02
- Published: 2018-01-25
- Granted: 2019-12-31
- Earliest claimed: 2015-06-14
- Assignees: Facense Ltd.
- Applicants: Facense Ltd.
- Inventors: Arie Tzvieli; Gil Thieberger; Ari M Frank
- Web page: https://patentgrep.com/patent/US10523852B2

## CPC

- H04N 23/55: Optical parts specially adapted for electronic image sensors; Mounting thereof
- A61B 5/0075: {by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy (A61B5/0071 takes precedence)}
- A61B 5/015: {By temperature mapping of body part}
- A61B 5/163: {by tracking eye movement, gaze, or pupil change}
- A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety}
- A61B 5/6803: {Head-worn items, e.g. helmets, masks, headphones or goggles}
- A61B 5/6814: {Head}
- G01J 5/0025: {Living bodies (ear thermometers G01J5/0011; detecting, measuring or recording for diagnostic purposes A61B5/00)}
- G02B 27/0172: {characterised by optical features}
- G02B 27/0176: {characterised by mechanical features}
- G06N 3/09: Supervised learning
- G06N 20/00: Machine learning
- H04N 23/23: from thermal infrared radiation
- A61B 5/0077: {Devices for viewing the surface of the body, e.g. camera, magnifying lens}
- A61B 2562/0271: Thermal or temperature sensors
- G02B 2027/0138: {comprising image capture systems, e.g. camera}
- G06N 3/044: Recurrent networks, e.g. Hopfield networks
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D)
- G01J: MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY (light sources F21, H01J, H01K, H05B; investigating properties of materials by optical means G01N)
- G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS

## Abstract

One aspect of this disclosure involves a wearable device that includes a frame that is worn on a user's head, and an inward-facing camera (camera) physically coupled to the frame. The optical axis of the camera is either above the Frankfort horizontal plane and pointed upward to capture an image of a region of interest (ROI) above the user's eyes, or the optical axis is below the Frankfort horizontal plane and pointed downward to capture an image of an ROI below the user's eyes. The camera includes a sensor and a lens. The sensor plane is tilted by more than 2° relative to the lens plane according to the Scheimpflug principle in order to capture a sharper image. The Scheimpflug principle is a geometric rule that describes the orientation of the plane of focus of a camera when the lens plane is tilted relative to the sensor plane.

## Claims

### Claim 1

A wearable device, comprising:
a frame configured to be worn on a user's head; and
an inward-facing camera (camera) physically coupled to the frame; wherein the optical axis of the camera is either above the Frankfort horizontal plane and pointed upward to capture an image of a region of interest (ROI) above the user's eyes, or the optical axis is below the Frankfort horizontal plane and pointed downward to capture an image of an ROI below the user's eyes;
the camera comprises a sensor and a lens; wherein the sensor plane is tilted by more than 2° relative to the lens plane according to the Scheimpflug principle in order to capture a sharper image.

### Claim 2 (depends on 1)

The wearable device of claim 1, wherein the ROI covers first and second areas, and the tilt between the lens plane and the sensor plane is adjusted such that the image of the first area is shaper than the image of the second area; whereby the first area is more important for detecting a physiological response of the user than the second area.

### Claim 3 (depends on 2)

The wearable device of claim 2, wherein the first area is on the user's upper lip and the second area is on the user's cheek, and the tilt is adjusted such that the image of the first area is shaper than the image of the second area.

### Claim 4 (depends on 2)

The wearable device of claim 2, wherein the first area is on the user's upper lip and the second area is on the user's nose, and the tilt is adjusted such that the image of the first area is shaper than the image of the second area.

### Claim 5 (depends on 2)

The wearable device of claim 2, wherein the first area is on the user's lips and the second area is on the user's chin, and the tilt is adjusted such that the image of the first area is shaper than the image of the second area.

### Claim 6 (depends on 2)

The wearable device of claim 2, wherein the camera is a visible-light camera, the first area is on the user's lower forehead (including an eyebrow) and the second area is on the user's upper forehead, and the tilt is adjusted such that the image of the first area is shaper than the image of the second area.

### Claim 7 (depends on 2)

The wearable device of claim 2, wherein the camera is a thermal camera, the first area is on the middle and upper part of the user's forehead (below the hair line), the second area is on the lower part of the user's forehead, and the tilt is adjusted such that the image of the first area is shaper than the image of the second area.

### Claim 8 (depends on 1)

The wearable device of claim 1, wherein the ROI covers a first area on the cheek straight above the upper lip, a second area on the cheek from the edge of the upper lip towards the ear, and a third area on the nose; wherein the tilt between the lens plane and the sensor plane is adjusted such that the image of the first area is shaper than both the images of the second and third areas.

### Claim 9 (depends on 1)

The wearable device of claim 1, wherein the ROI covers both the region on the user's upper lip and a second region on the body below the face when the user is standing; and wherein the sharpness of the image of both the region and the second region, which is obtained from the camera when the user wears the frame, is better than the sharpness of an image of both the region and the second region that would be obtained from a similar camera having the same sensor and lens, but with the lens plane parallel to the sensor plane.

### Claim 10 (depends on 1)

The wearable device of claim 1, wherein the camera is a thermal camera configured to take thermal measurements of the ROI; and further comprising a computer configured to detect a physiological response based on the thermal measurements.

### Claim 11 (depends on 10)

The wearable device of claim 10, wherein the sensor comprises multiple sensing elements, and the computer is configured to process time series measurements of each sensing element individually in order to detect the physiological response.

### Claim 12 (depends on 10)

The wearable device of claim 10, wherein the thermal camera weighs below 10 g, is located less than 10 cm from the user's face, and the tilt of the lens plane relative to the sensor plane is fixed; and wherein the fixed tilt is selected according to an expected orientation between the camera and the ROI when the user wears the frame.

### Claim 13 (depends on 1)

The wearable device of claim 1, wherein the camera is a visible-light camera configured to take visible-light images of the ROI; and further comprising a computer configured to generate an avatar of the user based on the visible-light images.

### Claim 14 (depends on 1)

The wearable device of claim 1, wherein the camera is a visible-light camera configured to take visible-light images of the ROI; and further comprising a computer configured to detect the user's emotional response based on identifying facial expressions in the visible-light images.

### Claim 15 (depends on 1)

The wearable device of claim 1, wherein the camera is a light field camera configured to: (i) implement a predetermined blurring at a certain Scheimpflug angle, and (ii) decode the predetermined blurring as function of the certain Scheimpflug angle.

### Claim 16 (depends on 1)

The wearable device of claim 1, further comprising an adjustable electromechanical tilting mechanism configured to change the tilt of the lens plane relative to the sensor plane according to the Scheimpflug principle, based on the orientation between the camera and the ROI when the camera is mounted on the user's head.

### Claim 17 (depends on 16)

The wearable device of claim 16, wherein the camera, including the adjustable electromechanical tilting mechanism, weighs less than 10 g, located less than 15 cm from the user's face, and the adjustable electromechanical tilting mechanism is able to change the tilt between the lens and sensor planes in a limited range below 30° between the two utmost orientations between the lens and sensor planes.

### Claim 18 (depends on 16)

The wearable device of claim 16, wherein the camera, including the adjustable electromechanical tilting mechanism, weighs less than 10 g, located less than 15 cm from the user's face, and the adjustable electromechanical tilting mechanism is able to change the tilt between the lens and sensor planes in a limited range below 20° between the two utmost orientations between the lens and sensor planes.

### Claim 19

A device comprising:
an inward-facing head-mounted camera (camera) configured to capture, when worn on a user's head, an image of a region of interest (ROI) on at least one of the following regions on the user's face: the forehead, the nose, the upper lip, a cheek, and the lips; and
the camera comprises a sensor and a lens; wherein the sensor plane is tilted by more than 2° relative to the lens plane according to the Scheimpflug principle in order to capture a sharper image.

### Claim 20 (depends on 19)

The device of claim 19, wherein the ROI covers first and second areas, and the tilt between the lens plane and the sensor plane is adjusted such that the image of the first area is shaper than the image of the second area, whereby the first area is more important for detecting a physiological response of the user than the second area.