Back to results
US 12,731,222 B2Granted
Image processing device and operating method thereof
AssigneesSamsung Electronics Co., Ltd., Korea Advanced Institute of Science and Technology
InventorsSoongeun Jang, Changick Kim, Woo-Shik Kim, Hongkyu Park, Sangyun Lee, Sangyoon Lee, Junho Lee, Minbeom Kim, Yooseung Wang, Jaehyuk Jang, Seungjun Jeong
Life of this patent
Estimating the term…
Abstract
An image processing device includes an image sensor including a unit block including a plurality of pixels arranged adjacent to each other, wherein a plurality of nano-posts are arranged on the unit block, and a processor that processes an input image acquired through the image sensor.
Claims20
An image processing device comprising:
- an image sensor comprising a unit block comprising a plurality of pixels arranged adjacent to each other, and a plurality of nano-posts arranged on the unit block;
- and
- a processor configured to process an input image acquired through the image sensor by:
- dividing the input image into a plurality of first sub-images of a Bayer pattern including pixels having a same parallax among the plurality of pixels included in the input image;
- converting the plurality of first sub-images into a plurality of RGB demosaic images;
- converting the plurality of RGB demosaic images into a plurality of YCbCr images comprising first luminance data and color difference data;
- generating second luminance data by applying the first luminance data, from among the plurality of YCbCr images, to a super resolution algorithm;
- generating third luminance data by upscaling the first luminance data;
- generating fourth luminance data by performing a weighted sum operation on the second luminance data and the third luminance data based on an attention map generated by the super resolution algorithm;
- acquiring a plurality of second YCbCr images by updating the first luminance data of the plurality of YCbCr images to the fourth luminance data;
- and
- generating an output image by merging a plurality of second sub-images generated based on the plurality of second YCbCr images.
9 more elements
An operating method of an image processing device, the operating method comprising:
- acquiring an input image through an image sensor including a unit block including a plurality of pixels arranged adjacent to each other, and a plurality of nano-posts arranged on the unit block;
- dividing the input image into a plurality of first sub-images of a Bayer pattern comprising pixels having a same parallax among the plurality of pixels included in the input image;
- converting the plurality of first sub-images into a plurality of RGB demosaic images;
- converting the plurality of RGB demosaic images into a plurality of YCbCr images comprising first luminance data and color difference data;
- generating second luminance data by applying the first luminance data, from among the plurality of YCbCr images, to a super resolution algorithm;
- generating third luminance data by upscaling the luminance data;
- generating fourth luminance data by performing a weighted sum operation on the second luminance data and the third luminance data based on an attention map generated by the super resolution algorithm;
- acquiring a plurality of second YCbCr images by updating the first luminance data of the plurality of YCbCr images to the fourth luminance data;
- and
- generating an output image by merging a plurality of second sub-images generated based on the plurality of second YCbCr images.
7 more elements
Dependencies are inferred from the claim text.