# US 12,008,769 B2 · Image processing apparatus and operating method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,769 B2 - Document ID: US12008769B2 - Status: Granted - Kind: B2 - Application number: 17/294,000 - Filed: 2019-11-11 - Published: 2022-01-13 - Granted: 2024-06-11 - Earliest claimed: 2018-11-16 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Dubok Park; Kwanghyun Won; Tammy Lee - Web page: https://patentgrep.com/patent/US12008769B2 ## CPC - G06T 7/20: Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) - G06T 3/40: Scaling of whole images or parts thereof, e.g. expanding or contracting - G06T 7/223: using block-matching - G06T 7/269: using gradient-based methods - G06T 7/97: {Determining parameters from multiple pictures (depth or shape recovery from multiple images G06T7/55; stereo camera calibration G06T7/85)} - H04N 5/14: Picture signal circuitry for video frequency region (cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00) - H04N 21/4402: involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)} - G06T 2207/30196: Human being; Person - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Provided is an image processing apparatus including a memory storing one or more instructions, and a processor executing the one or more instructions stored in the memory, wherein the processor retargets a current frame image, based on a first scale factor for a previous frame image, a second scale factor for the current frame image, and a weight determined based on previous frame image data and current frame image data. ## Claims ### Claim 1 An image processing apparatus comprising: a memory storing one or more instructions; and a processor executing the one or more instructions stored in the memory, wherein the processor retargets a current frame image, based on a first scale factor for a previous frame image, a second scale factor for the current frame image, and a weight determined based on previous frame image data and current frame image data, wherein the processor analyzes motion information of an object in the current frame image, based on the previous frame image and the current frame image, and determines the weight, based on the motion information, to increase a ratio of reflecting the second scale factor to the retargeted frame image when motion of the object is large, and determines the weight to reduce the ratio of reflecting the second scale factor to the retargeted frame image when motion of the object is small. ### Claim 2 (depends on 1) The image processing apparatus of claim 1, wherein the processor determines the weight, based on a variance between the first and second scale factors. ### Claim 3 (depends on 2) The image processing apparatus of claim 2, wherein the processor determines the weight to reduce a ratio of reflecting the second scale factor to the retargeted frame image when the variance between the first and second scale factors is large, or determines the weight to increase the ratio of reflecting the second scale factor to the retargeted frame image when the variance between the first and second scale factors is small. ### Claim 4 (depends on 1) The image processing apparatus of claim 1, wherein the processor differently sets the weight depending on a position of pixels, to which the weight is applied, in the current frame image. ### Claim 5 (depends on 1) The image processing apparatus of claim 1, wherein the processor determines the first scale factor corresponding to a first area comprised in the previous frame image, based on saliency of the first area, and determines the second scale factor corresponding to a second area comprised in the current frame image, based on saliency of the second area. ### Claim 6 (depends on 5) The image processing apparatus of claim 5, wherein the processor determines the first scale factor corresponding to the first area, to be a large value when the saliency of the first area is large, and determines the second scale factor corresponding to the second area, to be a large value when the saliency of the second area is large. ### Claim 7 (depends on 1) The image processing apparatus of claim 1, wherein the processor determines a third scale factor for the current frame image by using the first scale factor, the second scale factor, and the weight, and retargets the current frame image by applying the third scale factor to the current frame image. ### Claim 8 (depends on 7) The image processing apparatus of claim 7, wherein the weight represents a ratio of reflecting the second scale factor to the third scale factor. ### Claim 9 (depends on 1) The image processing apparatus of claim 1, wherein the processor outputs the retargeted frame image, and wherein an aspect ratio of the output frame image differs from an aspect ratio of the current frame image. ### Claim 10 A method of operating an image processing apparatus, the method comprising: determining a first scale factor for a previous frame image, and a second scale factor for a current frame image; determining a weight, based on previous frame image data and current frame image data; and retargeting the current frame image, based on the first scale factor, the second scale factor, and the weight, wherein the determining of the weight comprises: analyzing motion information of an object in the current frame image, based on the previous frame image and the current frame image; and determining the weight, based on the motion information, to increase a ratio of reflecting the second scale factor to the retargeted frame image when motion of the object is large, and determining the weight to reduce the ratio of reflecting the second scale factor to the retargeted frame image when motion of the object is small. ### Claim 11 (depends on 10) The method of claim 10, wherein the determining of the weight comprises determining the weight, based on a variance between the first and second scale factors.