Back to results
US 12,711,804 B2Granted
Information processing apparatus, image sensor, and control method using on-sensor image recognition
AssigneeSony Semiconductor Solutions Corporation
InventorHisashi Nishimaki
Life of this patent
Estimating the term…
Abstract
The present technology relates to an information processing apparatus and an information processing method which are capable of reducing power consumption that impairs convenience. An image of a predetermined detection target is included in a captured image captured by an image sensor, an output image output from the image sensor is acquired, predetermined processing is executed on the output image, and the output image is output from the image sensor in a case where it is detected that the image of the detection target is included.
Claims19
An information processing apparatus, comprising:
- an image sensor configured to capture an image in an image frame, wherein the image sensor includes image recognition circuitry configured to:
- execute image recognition on image data, obtained by a light receiving circuitry of the image sensor, based on an inference model having a Deep Neural Network (DNN) structure;
- detect that an image of a specific detection target is included in the captured image captured by the image sensor;
- and
- output a detection result including a detection trigger;
- and
- processing circuitry, switchable between an activated state and a power-saving state, configured to:
- in the power-saving state, cause the image sensor to operate in a sensing mode in which the image sensor executes the image recognition by the image recognition circuitry while suppressing transfer of the image data to the processing circuitry,
- based on reception of the detection trigger from the image sensor,
- transition from the power-saving state to the activated state, acquire an output image output from the image sensor, execute a specific processing on the output image, and
- cause the image sensor to stop or change the sensing mode after completion of the specific processing.
8 more elements
An information processing apparatus, comprising:
- an image sensor configured to capture an image in an image frame, wherein the image sensor includes image recognition circuitry configured to:
- execute image recognition on image data, obtained by light receiving circuitry of the image sensor, based on an inference model having a deep neural network structure;
- detect whether an image of a specific detection target is included in the captured image captured by the image sensor;
- and
- processing circuitry, switchable between an activated state and a power-saving state, configured to:
- in the power-saving state, cause the image sensor to operate in a sensing mode in which the image sensor executes the image recognition by the image recognition circuitry while suppressing transfer of the image data to the processing circuitry,
- execute a specific processing based on a result that is output from the image sensor and is detected by the image recognition circuitry, and
- cause the image sensor to stop or change the sensing mode after completion of the specific processing.
5 more elements
An information processing method, comprising:
- in an information processing apparatus having an image sensor:
- executing, by image recognition circuitry of the image sensor, image recognition on image data, obtained by light receiving circuitry of the image sensor, based on an inference model having a deep neural network structure;
- detecting, by the image recognition circuitry, that an image of a specific detection target is included in a captured image captured by the image sensor;
- outputting, by the image recognition circuitry, a detection result including a detection trigger;
- and
- based on reception of the detection trigger from the image sensor,
- transitioning, by processing circuitry of the information processing apparatus, from a power-saving state to an activated state, wherein
- the processing circuitry is switchable between the activated state and the power-saving state, and
- in the power-saving state, the processing circuitry is configured to cause the image sensor to operate in a sensing mode in which the image sensor executes the image recognition by the image recognition circuitry while suppressing transfer of the image data to the processing circuitry,
- acquiring, by the processing circuitry, an output image output from the image sensor,
- executing, by the processing circuitry, a specific processing on the output image, and
- causing, by the processing circuitry, the image sensor to stop or change the sensing mode after completion of the specific processing.
9 more elements
A non-transitory computer readable medium having stored thereon, computer executable instructions, which when executed by a computer, cause the computer to execute operations:
- executing, by image recognition circuitry of an image sensor included in an information processing apparatus, image recognition on image data, obtained by light receiving circuitry of the image sensor, based on an inference model having a deep neural network structure;
- detecting, by the image recognition circuitry, that an image of a specific detection target is included in a captured image by the image sensor;
- outputting, by the image recognition circuitry, a detection result including a detection trigger;
- and
- based on reception of the detection trigger from the image sensor,
- transitioning, by processing circuitry of the information processing apparatus, from a power-saving state to an activated state, wherein
- the processing circuitry is switchable between the activated state and the power-saving state, and
- in the power-saving state, the processing circuitry is configured to cause the image sensor to operate in a sensing mode in which the image sensor executes the image recognition by the image recognition circuitry while suppressing transfer of the image data to the processing circuitry,
- acquiring, by the processing circuitry, an output image output from the image sensor,
- executes predetermined executing, by the processing circuitry, a specific processing on the output image, and
- causing, by the processing circuitry, the image sensor to stop or change the sensing mode after completion of the specific processing.
8 more elements
Dependencies are inferred from the claim text.