Image sensor and operating method of image sensor
AssigneeSamsung Electronics Co., Ltd.
InventorsJeisung Lee, Hansol Lee
Life of this patent
Estimating the term…
Abstract
Provided are an image sensor and an operating method of the image sensor. The image sensor includes a pixel array configured to convert optical signals that are received, into electrical signals, a readout circuit configured to convert the electrical signals into image data and to output the image data, and a bad-pixel correction circuit configured to correct a cluster bad pixel included in the image data based on a neural network without performing a convolution operation.
Claims20
An image sensor comprising:
- a pixel array configured to convert optical signals into electrical signals;
- a readout circuit configured to convert the electrical signals into image data and output the image data;
- and
- a bad-pixel correction circuit configured to correct a cluster bad pixel included in the image data based on a neural network without performing a convolution operation, the neural network comprising a plurality of fully connected layers connected to each other and receiving a flattened one dimensional N1×1 matrix as an input,
- wherein a first fully connected layer, among the plurality of fully connected layers, is configured to:
- receive the flattened one dimensional N1×1 matrix,
- generate an one dimensional N2×1 matrix based on the flattened one dimensional N1×1 matrix and a first kernel, and
- output the one dimensional N2×1 matrix to a second fully connected layer, among the plurality of fully connected layers,
- wherein N1 and N2 are integers.
An image sensor comprising:
- a pixel array configured to convert optical signals into electrical signals;
- a readout circuit configured to convert the electrical signals into image data and output the image data, the image data comprising a plurality of pixel groups each comprising pixels of a same color arranged in an N×N matrix, and N being an integer of 2 or more;
- and
- an image signal processor configured to correct a cluster bad pixel occurring in at least one of the plurality of pixel groups based on a neural network without including a convolutional layer,
- wherein the neural network comprises a plurality of fully connected layers connected to each other and receiving a flattened one dimensional N1×1 matrix as an input,
- wherein a first fully connected layer, among the plurality of fully connected layers, is configured to:
- receive the flattened one dimensional N1×1 matrix,
- generate an one dimensional N2×1 matrix based on the flattened one dimensional N1×1 matrix and a first kernel, and
- output the one dimensional N2×1 matrix to a second fully connected layer, among the plurality of fully connected layers,
- wherein N1 and N2 are integers.
An operating method of an image sensor, the operating method comprising:
- generating image data based on an optical signal;
- detecting a cluster bad pixel in the image data;
- generating corrected pixel data, by operating a neural network without including a convolutional layer, based on input data comprising the cluster bad pixel and pixels around the cluster bad pixel;
- and
- correcting the cluster bad pixel based on the corrected pixel data,
- wherein the neural network comprises a plurality of fully connected layers connected to each other and receiving a flattened one dimensional N1×1 matrix as an input, and
- wherein the method further comprises:
- by a first fully connected layer, among the plurality of fully connected layers:
- receiving the flattened one dimensional N1×1 matrix,
- generating an one dimensional N2×1 matrix based on the flattened one dimensional N1×1 matrix and a first kernel, and
- outputting the one dimensional N2×1 matrix to a second fully connected layer, among the plurality of fully connected layers,
- wherein N1 and N2 are integers.
Dependencies are inferred from the claim text.