# US 2016/0366367 A1 · Fallback in frame rate conversion system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2016/0366367 A1 - Document ID: US20160366367A1 - Status: Published application - Kind: A1 - Application number: 14/738,056 - Filed: 2015-06-12 - Published: 2016-12-15 - Earliest claimed: 2015-06-12 - Assignees: Sharp Laboratories of America, Inc. - Applicants: Sharp Laboratories of America, Inc. - Inventors: Xu CHEN; Petrus J.L. VAN BEEK - Web page: https://patentgrep.com/patent/US20160366367A1 ## CPC - H04N 7/0127: {by changing the field or frame frequency of the incoming video signal, e.g. frame rate converter} - G06T 5/50: using two or more images, e.g. averaging or subtraction - G06T 5/73: Deblurring; Sharpening - G06T 7/0002: {Inspection of images, e.g. flaw detection} - H04N 7/014: {involving the use of motion vectors (motion estimation and compensation in video coding H04N19/51)} - G06T 2207/10016: Video; Image sequence - G06T 2207/20064: Wavelet transform [DWT] - G06T 2207/20201: Motion blur correction - G06T 2207/30168: Image quality inspection - H04N 5/144: {Movement detection (for video coding H04N19/503; analysis of motion in general G06T7/20)} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A system for frame rate conversion of a video that includes detecting low quality of a received frame and determining an interpolated frame of the video based upon the detected low quality of the received frame. ## Claims ### Claim 1 A method for frame rate conversion of a video comprising: (a) receiving a plurality of frames of said video; (b) detecting a low quality of a received frame of said video; (c) determining an interpolated frame of said video temporally proximate said frame of said video based upon said detecting said low quality of said received frame; (d) wherein said determining said interpolated frame of said video temporally proximate said frame of said video is based upon a reliability factor of motion vectors of said frame; (e) wherein said determining said interpolated frame based upon said reliability factor of said motion vectors is selectively used to (1) determine pixels of said interpolated frame using said motion vectors when said reliability factor of said motion vectors of said frame is sufficiently high, and (2) not determine said pixels of said interpolated frame using said motion vectors when said reliability factor of said motion vectors of said frame is not said sufficiently high. ### Claim 2 (depends on 1) The method of claim 1 wherein said detecting said low quality said received frame is based on a blur confidence measure. ### Claim 3 (depends on 1) The method of claim 1 wherein said blur estimation is based upon a presence of fast motion dominating a large portion of said frame. ### Claim 4 (depends on 2) The method of claim 2 wherein said blur confidence measure is based on an analysis of edges of said frame. ### Claim 5 A method for frame rate conversion of a video comprising: (a) receiving a plurality of frames of said video; (b) detecting a low quality of a received frame of said video; (c) determining an interpolated frame of said video temporally proximate said frame of said video based upon said detecting said low quality of said received frame; (d) wherein said determining said interpolated frame of said video temporally proximate said frame of said video is based upon a reliability factor of motion vectors of said frame; (e) wherein said detecting said low quality said received frame is based on a blur confidence measure; (f) wherein said blur confidence measure is based on an analysis of edges of said frame; (g) wherein said blur confidence measure is based on an analysis of the sharpness of said edges of said frame. ### Claim 6 A method for frame rate conversion of a video comprising: (a) receiving a plurality of frames of said video; (b) detecting a low quality of a received frame of said video; (c) determining an interpolated frame of said video temporally proximate said frame of said video based upon said detecting said low quality of said received frame; (d) wherein said determining said interpolated frame of said video temporally proximate said frame of said video is based upon a reliability factor of motion vectors of said frame; (e) wherein said detecting said low quality said received frame is based on a blur confidence measure; (f) wherein said blur confidence measure is based on an analysis of edges of said frame; (g) wherein said blur confidence measure is based on a wavelet transform. ### Claim 7 A method for frame rate conversion of a video comprising: (a) receiving a plurality of frames of said video; (b) detecting a low quality of a received frame of said video; (c) determining an interpolated frame of said video temporally proximate said frame of said video based upon said detecting said low quality of said received frame; (d) wherein said determining said interpolated frame of said video temporally proximate said frame of said video is based upon a reliability factor of motion vectors of said frame; (e) wherein said detecting said low quality said received frame is based on a blur confidence measure; (f) wherein said blur estimation is based upon a presence of fast motion dominating a large portion of said frame; (g) wherein said fast motion is based upon a magnitude of motion vectors of said frame. ### Claim 8 (depends on 7) The method of claim 7 wherein said fast motion is based upon a horizontal component of said motion vectors of said frame. ### Claim 9 (depends on 8) The method of claim 8 wherein said fast motion is based upon a vertical component of said motion vectors of said frame. ### Claim 10 (depends on 1) The method of claim 1 wherein said reliability factor of said motion vectors is a spatial error measure. ### Claim 11 (depends on 1) The method of claim 1 wherein said reliability factor of said motion vectors is a temporal error measure. ### Claim 12 (depends on 10) The method of claim 10 wherein said spatial error measure is a spatial motion vector variance. ### Claim 13 (depends on 11) The method of claim 11 wherein said temporal error measure is a temporal motion compensated error. ### Claim 14 (depends on 13) The method of claim 13 wherein said temporal motion compensated error is based upon a block based motion compensation. ### Claim 15 A method for frame rate conversion of a video comprising: (a) receiving a plurality of frames of said video; (b) detecting a low quality of a received frame of said video; (c) determining an interpolated frame of said video temporally proximate said frame of said video based upon said detecting said low quality of said received frame; (d) wherein said determining said interpolated frame of said video temporally proximate said frame of said video is based upon a reliability factor of motion vectors of said frame; (e) wherein said reliability factor of said motion vectors is a temporal error measure; (f) wherein said temporal error measure is a temporal motion compensated error; (g) wherein said temporal motion compensated error is based upon a block based motion compensation; (h) wherein said temporal motion compensated error includes weighting central blocks of said frame to a greater degree than non-central blocks of said frame. ### Claim 16 A method for frame rate conversion of a video comprising: (a) receiving a plurality of frames of said video; (b) detecting a low quality of a received frame of said video; (c) determining an interpolated frame of said video temporally proximate said frame of said video based upon said detecting said low quality of said received frame; (d) wherein said determining said interpolated frame of said video temporally proximate said frame of said video is based upon a reliability factor of motion vectors of said frame; (e) wherein said reliability factor of said motion vectors is a spatial error measure (f) wherein said spatial error measure is a spatial motion vector variance; (g) wherein said spatial motion vector variance includes a comparison between a local variance and a global mean of said local variance.