# US 11,310,460 B2 · Image processing method > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,310,460 B2 - Document ID: US11310460B2 - Status: Granted - Kind: B2 - Application number: 17/152,868 - Filed: 2021-01-20 - Published: 2021-11-18 - Granted: 2022-04-19 - Earliest claimed: 2020-05-18 - Assignees: Realtek Semiconductor Corp. - Applicants: Realtek Semiconductor Corporation - Inventors: Chung-Ping Yu - Web page: https://patentgrep.com/patent/US11310460B2 ## CPC - H04N 7/014: {involving the use of motion vectors (motion estimation and compensation in video coding H04N19/51)} - G09G 5/005: {Adapting incoming signals to the display format of the display terminal} - H04N 7/0127: {by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter} - G06F 3/147: using display panels - G09G 2320/106: Determination of movement vectors or equivalent parameters within the image - G09G 2340/0435: Change or adaptation of the frame rate of the video stream - G09G 2340/16: Determination of a pixel data signal depending on the signal applied in the previous frame - H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) - H04N 19/132: Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking - H04N 19/139: Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability - H04N 19/513: Processing of motion vectors - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An image processing method includes: receiving first and second frames; generating multiple motion vectors based on the first and second frames, wherein one of the motion vectors corresponds to a first block of the first frame and a second block of the second frame; calculating a to-be-compensated position of a compensated block, a first motion vector between the compensated block and the first block, and a second motion vector between the compensated block and the second block; determining whether a sum of the to-be-compensated position, a compensation value, and the first motion vector or the second motion vector exceeds a target range in order to set a blending coefficient; modifying first data of the first block or second data of the second block based on the blending coefficient; and generating interpolated data based on the modified first data or the modified second data. ## Claims ### Claim 1 An image processing method comprising: receiving a first frame and a second frame; generating multiple motion vectors based on the first frame and the second frame, wherein one of the motion vectors corresponds to a first block of the first frame and a second block of the second frame; calculating a to-be-compensated position of a compensated block, a first motion vector between the compensated block and the first block, and a second motion vector between the compensated block and the second block; determining whether a sum of the to-be-compensated position, a compensation value, and the first motion vector or the second motion vector exceeds a target range in order to set a blending coefficient; modifying first data of the first block or second data of the second block based on the blending coefficient; and generating interpolated data based on the modified first data or the modified second data. ### Claim 2 (depends on 1) The image processing method of claim 1, wherein setting the blending coefficient comprises: setting a first blending coefficient of the first block to the compensation value when a sum of the to-be-compensated position, the first motion vector and the compensation value exceeds the target range; setting a second blending coefficient of the second block to the compensation value when a sum of the compensation position, the second motion vector and the compensation value exceeds the target range; setting the first blending coefficient to “fail” when the sum of the compensation position, the first motion vector and the compensation value fails to exceed the target range; and marking the second blending coefficient to “fail” when the sum of the compensation position, the second motion vector and the compensation value fails to exceed the target range. ### Claim 3 (depends on 2) The image processing method of claim 2, wherein modifying the first data or the second data based on the blending coefficient comprises: modifying the first data based on the second data and the second blending coefficient when the first blending coefficient is not zero and the second blending coefficient is set to “fail”; and modifying the second data based on the first data and the first blending coefficient when the first blending coefficient is set to “fail” and the second blending coefficient is not zero. ### Claim 4 (depends on 2) The image processing method of claim 2, wherein the first blending coefficient is positively correlated with a value of the sum exceeding the target range, the second blending coefficient is positively correlated with the value of the sum exceeding the target range. ### Claim 5 (depends on 1) The image processing method of claim 1, wherein the target range comprises a frame area or a covered/uncovered area. ### Claim 6 (depends on 5) The image processing method of claim 5, further comprising: obtaining four boundaries of an input image by using a boundary detector; and using an area enclosed by the four boundaries as the frame area. ### Claim 7 (depends on 5) The image processing method of claim 5, further comprising: detecting the covered/uncovered area in the first frame and the second frame by using a covered/uncovered detector. ### Claim 8 (depends on 1) The image processing method of claim 1, wherein calculating the to-be-compensated position comprises: calculating a midpoint of the first block and the second block as the to-be-compensated position. ### Claim 9 (depends on 1) The image processing method of claim 1, wherein the compensation value is controllable. ### Claim 10 (depends on 1) The image processing method of claim 1, wherein generating the interpolated data comprises: calculating an arithmetic mean of the first data and the second data as the interpolated data.