# US 2013/0155309 A1 · Method and Apparatus for Controlling Camera Functions Using Facial Recognition and Eye Tracking

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0155309 A1
- Document ID: US20130155309A1
- Status: Published application
- Kind: A1
- Application number: 13/331,471
- Filed: 2011-12-20
- Published: 2013-06-20
- Earliest claimed: 2011-12-20
- Assignees: Research In Motion Limited
- Inventors: Samuel Aaron Hill; Thomas Casey Hill
- Web page: https://patentgrep.com/patent/US20130155309A1

## CPC

- H04N 23/675: {comprising setting of focusing regions}
- H04N 23/61: based on recognised objects
- H04N 23/635: {Region indicators; Field of view indicators}
- H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
- H04N 23/611: where the recognised objects include parts of the human body
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A device is provided. The device includes a primary camera to capture images, a secondary camera to capture images, a viewfinder, and a processor. The viewfinder can display images captured by the primary camera. The processor can provide eye tracking analysis on images captured by the secondary camera in order to determine a region of interest in the viewfinder. The processor further associates the region of interest with a portion of an image captured by the primary camera. The processor further initiates an autofocus procedure based on the region of interest.

## Claims

### Claim 1

A device, comprising:
a primary camera to capture images;
a secondary camera to capture images;
a viewfinder to display images captured by the primary camera; and
a processor to provide eye tracking analysis on images captured by the secondary camera in order to determine a region of interest in the viewfinder, the processor further associating the region of interest with a portion of an image captured by the primary camera and initiating an autofocus procedure based on the region of interest.

### Claim 2 (depends on 1)

The device of claim 1, wherein the viewfinder and a lens of the secondary camera are situated on the device in such a manner that focal planes of images captured by the secondary camera are substantially parallel to focal planes of images displayed on the viewfinder.

### Claim 3 (depends on 1)

The device of claim 1, wherein a visual indication is provided in the viewfinder to indicate the region of interest.

### Claim 4 (depends on 3)

The device of claim 3, wherein a size and shape of the visual indication is at least one of:
fixed; and
manually adjustable.

### Claim 5 (depends on 3)

The device of claim 3, wherein the visual indication moves based on results of the eye tracking analysis.

### Claim 6 (depends on 1)

The device of claim 1, wherein the eye tracking analysis is activated by a facial recognition analysis determining that a human face is looking toward the viewfinder.

### Claim 7 (depends on 1)

The device of claim 1, wherein the eye tracking analysis is activated by contact with a shutter button on the device.

### Claim 8 (depends on 1)

The device of claim 1, wherein focusing of the primary camera is performed without information from the secondary camera when a facial recognition analysis determines that a human face is not looking toward the viewfinder.

### Claim 9 (depends on 1)

The device of claim 1, wherein the device provides an option for selecting an autofocus procedure that does not use eye tracking analysis.

### Claim 10

A method for focusing a primary camera on a device, the primary camera capturing images for display on a viewfinder of the device, the method comprising:
performing eye tracking analysis on images captured by a secondary camera on the device;
selecting a region of interest within the viewfinder based on the eye tracking analysis;
associating the region of interest with a portion of an image captured by the primary camera; and
performing an autofocus procedure of the primary camera based on the region of interest.

### Claim 11 (depends on 10)

The method of claim 10, wherein a visual indication is provided in the viewfinder to indicate the region of interest.

### Claim 12 (depends on 11)

The method of claim 11, wherein a size and shape of the visual indication is at least one of:
fixed; and
manually adjustable.

### Claim 13 (depends on 11)

The method of claim 11, wherein the visual indication moves based on results of the eye tracking analysis.

### Claim 14 (depends on 10)

The method of claim 10, wherein the eye tracking analysis is activated by a facial recognition analysis determining that a human face is looking toward the viewfinder.

### Claim 15 (depends on 10)

The method of claim 10, wherein the eye tracking analysis is activated by contact with a shutter button on the device.

### Claim 16 (depends on 10)

The method of claim 10, wherein focusing of the primary camera is performed without information from the secondary camera when a facial recognition analysis determines that a human face is not looking toward the viewfinder.

### Claim 17 (depends on 10)

The method of claim 10, wherein the device provides an option for selecting an autofocus procedure that does not use eye tracking analysis.

### Claim 18

A device, comprising:
a primary camera;
a secondary camera; and
an eye tracking component configured to detect the gaze of an eye on an electronic viewfinder on the device and further configured to provide to the primary camera information related to a portion of the electronic viewfinder toward which the gaze is directed, wherein the primary camera performs an autofocus procedure based on a portion of a captured image corresponding to the portion of the electronic viewfinder toward which the gaze is directed.

### Claim 19 (depends on 18)

The device of claim 18, wherein a visual indication is provided in the electronic viewfinder to indicate the portion of the electronic viewfinder toward which the gaze is directed.

### Claim 20 (depends on 19)

The device of claim 19, wherein a size and shape of the visual indication is at least one of:
fixed; and
manually adjustable.

### Claim 21 (depends on 19)

The device of claim 19, wherein the visual indication moves in tandem with the gaze.

### Claim 22 (depends on 18)

The device of claim 18, wherein the eye tracking component is activated by a facial recognition analysis recognizing that a human face is looking toward the electronic viewfinder.

### Claim 23 (depends on 18)

The device of claim 18, wherein the eye tracking component is activated by contact with a shutter button on the device.

### Claim 24 (depends on 18)

The device of claim 18, wherein, when a facial recognition component in the device determines that a human face is not looking toward the electronic viewfinder, focusing of the primary camera is performed without information from the secondary camera.

### Claim 25 (depends on 18)

The device of claim 18, wherein the device provides an option for selecting an autofocus procedure that does not use information from the eye tracking component.
