# US 10,313,570 B2 · Dynamic conservation of imaging power

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 10,313,570 B2
- Document ID: US10313570B2
- Status: Granted
- Kind: B2
- Application number: 15/657,861
- Filed: 2017-07-24
- Published: 2017-11-09
- Granted: 2019-06-04
- Earliest claimed: 2012-11-21
- Assignees: Infineon Technologies AG
- Applicants: Infineon Technologies AG
- Inventors: Michael Mark; Markus Dielacher; Martin Flatscher; Josef Prainsack; Martin Gotschlich
- Web page: https://patentgrep.com/patent/US10313570B2

## CPC

- H04N 23/56: provided with illuminating means
- G06F 1/1686: {the I/O peripheral being an integrated camera}
- G06F 1/3231: Monitoring the presence, absence or movement of users
- G06F 1/325: {Power saving in peripheral device}
- G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)}
- G06F 3/0304: {Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042)}
- H04N 13/286: having separate monoscopic and stereoscopic modes
- H04N 23/61: based on recognised objects
- H04N 23/651: {for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera}
- H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects
- Y02D 10/00: Energy efficient computing, e.g. low power processors, power management or thermal management
- Y02D 30/50: in wire-line communication networks, e.g. low power modes or reduced link rate
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)
- Y02D: CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE

## Abstract

Representative implementations of devices and techniques provide adaptable settings for imaging devices and systems. Operating modes may be defined based on whether movement is detected within a predetermined area. One or more parameters of illumination or modulation may be dynamically adjusted based on the present operating mode.

## Claims

### Claim 1

An apparatus, comprising:
a sensor configured to capture a two-dimensional image of an area in a first operating mode and a three-dimensional image of the area in a second operating mode;
an illuminator configured to illuminate at least a portion of the area; and
a controller configured to:
determine a difference between the two-dimensional image or the three-dimensional image and a previously captured image of the area,
determine an operating mode of the apparatus based on whether the difference indicates object movement within the area,
activate or deactivate the illuminator based on the determined operating mode, and
set the apparatus in the first operating mode when the difference indicates no object movement within the area.

### Claim 2 (depends on 1)

The apparatus of claim 1, wherein the controller is configured to set the apparatus in the first operating mode when the difference indicates no object movement within the area within a preset time duration.

### Claim 3 (depends on 1)

The apparatus of claim 1, wherein the controller is configured to deactivate the illuminator of the apparatus while in the first operating mode.

### Claim 4 (depends on 3)

The apparatus of claim 3, wherein the controller is configured to flash the illuminator of the apparatus while the sensor captures the two-dimensional image of the predetermined area, while in the first operating mode.

### Claim 5 (depends on 1)

The apparatus of claim 1, wherein the controller is configured to deactivate modulation of at least one of the illuminator of the apparatus and one or more photosensitive pixels of the sensor while in the first operating mode.

### Claim 6 (depends on 1)

The apparatus of claim 1, wherein the controller is configured to set the apparatus in the second operating mode when the difference indicates an object movement within the area.

### Claim 7 (depends on 6)

The apparatus of claim 6, wherein the second operating mode includes performing three-dimensional imaging arranged to detect a gesture within the area, based on time-of-flight principles.

### Claim 8 (depends on 6)

The apparatus of claim 6, wherein the controller is configured to activate the illuminator, the illuminator being configured to emit electromagnetic radiation to illuminate at least the portion of the area, while in the second operating mode.

### Claim 9 (depends on 8)

The apparatus of claim 8, further comprising a modulator, wherein the controller is configured to activate the modulator that is configured to modulate the electromagnetic radiation and/or one or more photosensitive pixels of the sensor while in the second operating mode.

### Claim 10

A system, comprising:
a sensor comprised of photosensitive pixels configured to capture a two-dimensional image of a predetermined area in a standby mode and a three-dimensional image of the predetermined area in an active mode;
an illuminator configured to emit light radiation based on an operating mode of the system;
a modulator configured to modulate one or more photosensitive pixels of the sensor and/or the light radiation based on the operating mode of the system; and
a controller configured to determine a difference between the two-dimensional image or the three-dimensional image and a previously captured image of the predetermined area, and to determine the operating mode of the system based on whether the difference indicates object movement within the predetermined area within a preset time duration.

### Claim 11 (depends on 10)

The system of claim 10, wherein the modulator is at least partially deactivated and the sensor is configured to capture the two-dimensional image of the predetermined area while the system is in the standby mode.

### Claim 12 (depends on 10)

The system of claim 10, wherein the one or more photosensitive pixels and/or the light radiation are not modulated while the system is in the standby mode.

### Claim 13 (depends on 10)

The system of claim 10, wherein the illuminator is deactivated or the illuminator is configured to emit a discontinuous flash of light radiation during capture of the two-dimensional image while the system is in the standby mode.

### Claim 14 (depends on 10)

The system of claim 10, wherein the illuminator is active and the one or more photosensitive pixels and the light radiation are modulated while the system is in the active mode.

### Claim 15 (depends on 10)

The system of claim 10, wherein the system comprises a three-dimensional gesture recognition system configured to detect a gesture within the predetermined area, based on receiving a reflection of the light radiation and based on time-of-flight principles.

### Claim 16

A method, comprising:
capturing a two-dimensional image of a predetermined area with a three-dimensional imager in a first operating mode;
capturing a three-dimensional image of the predetermined area with the three-dimensional imager in a second operating mode;
determining a difference between the two-dimensional image or the three-dimensional image and a previously captured image of the predetermined area;
operating the three-dimensional imager in the first operating mode when the difference indicates no object movement within the predetermined area within a preset time duration;
operating the three-dimensional imager in the second operating mode when the difference indicates an object movement within the predetermined area; and
illuminating at least a portion of the predetermined area based on which of the first and the second operating modes the three-dimensional imager is operating.

### Claim 17 (depends on 16)

The method of claim 16, further comprising deactivating an illumination of the predetermined area when no object movement is detected within the predetermined area within the preset time duration and activating an illumination of the predetermined area when an object movement is detected within the predetermined area.

### Claim 18 (depends on 16)

The method of claim 16, further comprising refraining from modulating one or more photosensitive pixels of the three-dimensional imager and/or refraining from modulating an illumination of the predetermined area while capturing the two-dimensional image, while in the first operating mode.

### Claim 19 (depends on 16)

The method of claim 16, further comprising reading a fraction of a current generated by one or more photosensitive pixels of the three-dimensional imager while in the first operating mode.

### Claim 20 (depends on 16)

The method of claim 16, further comprising using a plurality of photosensitive pixels of the three-dimensional imager to capture the three-dimensional image while in the second operating mode and using a fraction of the plurality of photosensitive pixels of the three-dimensional imager to capture the two-dimensional image while in the first operating mode.

### Claim 21 (depends on 16)

The method of claim 16, further comprising using a first frame rate for capturing an image while in the second operating mode and using a second, lower frame rate for capturing an image while in the first operating mode.

### Claim 22 (depends on 16)

The method of claim 16, further comprising binning photosensitive pixels of the three-dimensional imager while capturing an image in the first operating mode, the binning including combining a group of adjacent pixels and processing the group as single composite pixel.

### Claim 23 (depends on 16)

The method of claim 16, further comprising detecting a gesture within the predetermined area while operating in the second operating mode.

### Claim 24

A three-dimensional imaging device, comprising:
a sensor configured to use time-of-flight principles to capture a two-dimensional image of an area in a first operating mode and a three-dimensional image of the area in a second operating mode;
an illuminator configured to illuminate at least a portion of the area; and
a controller is configured to:
determine a difference between the two-dimensional image or the three-dimensional image and a previously captured image of the area,
set the device in the first operating mode when the difference indicates no object movement within the area within a preset time duration and to set the device in the second operating mode when the difference indicates an object movement within the area, and
activate or deactivate the illuminator based on which of the first and the second operating modes the device is set to operate in.
