US 2026/0270575 A1Published application

Sensor device and method for operating a sensor device

AssigneeSony Semiconductor Solutions Corporation

InventorsDimche KOSTADINOV, Ryoji IKEGAYA, Christian Peter BRÄNDLI

Life of this patent

Estimating the term…

Loading patent…

Abstract

A sensor device includes a vision sensor with a pixel array that receives light, performs photoelectric conversion, and outputs a data stream; a trigger unit that receives portions of the data stream and generates trigger signals based on the portions and, optionally, feedback from a processing unit; and the processing unit, which receives the trigger signals and executes predetermined processing on the indicated portions of the data stream. The processing unit employs a first machine-learning module trained to optimize the predetermined processing jointly with a second machine-learning module used by the trigger unit to produce the trigger signals and/or a third machine-learning module used by the vision sensor to generate the data stream.

Claims15

Dependent claims

A sensor device comprising:

a vision sensor that comprises a pixel array having a plurality of pixels each being configured to receive light and to perform photoelectric conversion to generate an electrical signal, based on which electrical signals a data stream is formed and output by the vision sensor;
a trigger unit that is configured to receive portions of the data stream and to generate trigger signals based on said portions of the data stream;
and
a processing unit that is configured to receive the trigger signals and to carry out a predetermined processing of a portion of the data stream for which the predetermined processing was indicated to be allowed by the respective trigger signal;
wherein
the processing unit is configured to use a first machine learning module to carry out the predetermined processing which first machine learning module has been trained such as to optimize the predetermined processing together with a second machine learning module used by the trigger unit to generate the trigger signals and/or a third machine learning module used by the vision sensor to generate the data stream.

3 more elements

A method for operating a sensor device, the method comprising

by a vision sensor that comprises a pixel array having a plurality of pixels each being configured to receive light and to perform photoelectric conversion to generate an electrical signal, forming and outputting a data stream based on the generated electrical signals;
by a trigger unit, receiving portions of the data stream and generating trigger signals based on said portions of the data stream;
by a processing unit, receiving the trigger signals and carrying out a predetermined processing of a portion of the data stream for which the predetermined processing was indicated to be allowed by the respective trigger signal by using a first machine learning module;
and
training the first machine learning module such as to optimize the predetermined processing together with a second machine learning module used for generating the trigger signals and/or a third machine learning module used for generating the data stream.

2 more elements

Dependencies are inferred from the claim text.