# US 8,786,711 B2 · Image quality evaluation system, and apparatus, method and program used for the evaluation system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 8,786,711 B2 - Document ID: US8786711B2 - Status: Granted - Kind: B2 - Application number: 12/747,308 - Filed: 2008-12-08 - Published: 2010-10-14 - Granted: 2014-07-22 - Earliest claimed: 2007-12-12 - Assignees: NEC Corporation - Applicants: Toru Yamada - Inventors: Toru Yamada - Web page: https://patentgrep.com/patent/US8786711B2 ## CPC - H04N 17/00: Diagnosis, testing or measuring for television systems or their details - H04N 17/004: {for digital television systems} - H04N 17/02: for colour television signals - H04N 19/12: Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264 - H04N 19/172: the region being a picture, frame or field - H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution - H04N 21/2365: Multiplexing of several video streams - H04N 21/4347: {Demultiplexing of several video streams} - H04N 21/4348: {Demultiplexing of additional data and video streams} - H04N 21/44008: {involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream (arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59)} - H04N 21/4425: Monitoring of client processing errors or hardware failure - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract Provided is an image quality evaluation system for evaluating quality of an image. The image quality evaluation system includes bit extraction means and image quality evaluation means. For predetermined data expressing an image frame of a first image, the bit extraction means extracts a predetermined number of bits which is smaller than the number of bits required for expressing one data piece. By using a value expressed by the bit string extracted by the bit extraction means and a value of data equivalent to the data to be extracted from the bit string in a second image, the image quality evaluation means estimates a difference between the first image and the second image and evaluates the image quality of the first to image or the second image. ## Claims ### Claim 1 An image quality evaluation system for evaluating an image quality of an image, comprising: a bit extraction unit that, for predetermined data expressive of an image, frame of a first image extracts continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; and an image quality evaluation unit that, based upon the value being expressed with bit sequences extracted by said bit extraction unit, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimates a difference between said first image and said second image, and evaluates the image quality of said first image or second image; an image sending apparatus for encoding the original image and transmitting said encoded image, and image reception apparatus for obtaining the transmitted image by receiving said encoded image from said image sending apparatus and decoding it: wherein the image sending apparatus comprises: a bit extraction unit that, for the predetermined data expressive of the original image, extracts predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data; and a feature transmission unit that transmits the value being expressed with the bit sequences extracted by said bit extraction unit as a feature of said original image to the image reception apparatus, being a transmission destination of said encoded image; and wherein the image reception apparatus comprises an image quality evaluation unit that estimates a difference between the original image and the transmitted image based upon the value that is expressed with the bit sequences extracted by said bit sequence extraction unit, said value being received as a feature of said original image, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in the image frame of the transmitted image, thereby to evaluate the image quality of the transmitted image. ### Claim 2 An image quality evaluation system for evaluating an image quality of an image, comprising: a bit extraction unit that, for predetermined data expressive of an image frame of a first image , extracts continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; and an image quality evaluation unit that, based upon the value being expressed with bit sequences extracted by said bit extraction unit, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimates a difference between said first image and said second image, and evaluates the image quality of said first image or second image; an image sending apparatus for encoding the original image and transmitting said encoded image, and an image reception apparatus for obtaining the transmitted image by receiving said encoded image from said image sending apparatus and decoding it: wherein the image reception apparatus comprises: a bit extraction unit that, for the predetermined data expressive of the image frame of the transmitted image, extracts predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data; and a feature transmission unit that transmits the value being expressed with the bit sequences extracted by said bit extraction unit as a feature of said transmitted image to the image sending apparatus, being a transmission source of said encoded image; and wherein the image sending apparatus comprises an image quality evaluation unit that estimates a difference between the original image and the transmitted image based upon the value that is expressed with the bit sequences extracted by said bit sequence extraction unit, said value received as a feature of said transmitted image, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in the image frame of the original image, thereby to evaluate the image quality of the transmitted image. ### Claim 3 An image quality evaluation system for evaluating an image quality of an image, comprising: a bit extraction unit that, for predetermined data expressive of an image frame of a first image, extracts continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per once piece of data except for predetermined high order bits and predetermined low order bits of the above data;and an image quality evaluation unit that, based upon the value being expressed with bit sequences extracted by said bit extraction unit, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimates a difference between said first image and said second image, and evaluates the image quality of said first image or second image; an image sending apparatus for encoding the original image and transmitting said encoded image, and an image reception apparatus for obtaining the transmitted image by receiving said encoded image from said image sending apparatus and decoding it: wherein the image sending apparatus comprises. bit extraction unit that, for the predetermined data expressive of the image frame of the decoded image that is obtained by decoding the encoded image without transmitting it, extracts predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data; and a feature transmission unit that transmits the value being expressed with the bit sequences extracted by said bit extraction unit as a feature of said decoded image to the image reception apparatus, being a transmission destination of said encoded image; and wherein the image reception apparatus comprises an image quality evaluation unit that estimates a difference between the decoded image and the transmitted image based upon the value that is expressed with the bit sequences extracted by said bit sequence extraction unit, said value received as a feature of said decoded image, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in the image frame of the transmitted image, thereby to evaluate the image quality of the transmitted image. ### Claim 4 An image quality evaluation system for evaluating an image quality of an image, comprising: bit extraction unit that, for predetermined data expressive of an image frame of a first image extracts continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; and an image quality evaluation unit that, based upon the value being expressed with bit sequences extracted by said bit extraction unit, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimates a difference between said first image and said second image, and evaluates the image quality of said first image or second image; an image sending apparatus for encoding the original image and transmitting said encoded image, and an image reception apparatus for obtaining the transmitted image by receiving said encoded image from said image sending apparatus and decoding it: wherein the image sending apparatus comprises: a bit extraction unit that, for the predetermined data expressive of the image frame of a locally-decoded image that is obtained in a course of encoding the original image, extracts predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data; and a feature transmission unit that transmits the value being expressed with the bit sequences extracted by said bit extraction unit as a feature of said locally decoded image to the image reception apparatus, being a transmission destination of said encoded image; and wherein the image reception apparatus comprises an image quality evaluation unit that estimates a difference between the locally-decoded image and the transmitted image based upon the value that is expressed with the bit sequences extracted by said bit sequence extraction unit, said value received as a feature of said locally-decoded image, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in the image frame of the transmitted image, thereby to evaluate the image quality of he transmitted image. ### Claim 5 An image quality evaluation method of evaluating an image quality of an image, comprising: for predetermined data expressive of an image frame of a first image, extracting continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; based upon the value that is expressed with extracted bit sequences, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimating a difference between said first image and said second image, thereby to evaluate the image quality of said first image or second image; and complementing, for the extracted bit sequence, high order bits not extracted at the moment of obtaining the above bit sequence with the value allowing a difference with data equivalent to the data that has become a target of extracting the above bit sequence in the second image to become minimized, thereby to estimate the value of the predetermined data expressive of the image frame of the first image that has become a target of extracting the above bit sequence. ### Claim 6 An image quality evaluation method of evaluating an image quality of an image, comprising: for predetermined data expressive of an image frame of a first image, extracting continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; based upon the value that is expressed with extracted bit sequences, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimating a difference between said first image and said second image, thereby to evaluate the image quality of said first image or second image; and complementing, for the extracted bit sequence, low order bits not extracted at the moment of obtaining the above bit sequence with an average value of values expressible with the above low order bits, thereby to estimate the value of the predetermined data expressive the image frame of the first image that has become a target of extracting the above bit sequence. ### Claim 7 An image quality evaluation method of evaluating an image quality of an image, comprising: for predetermined data expressive of an image frame of a first image, extracting continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; based upon the value that is expressed with extracted bit sequences, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimating a difference between said first image and said second image, thereby to evaluate the image quality of said first image or second image; and from the value obtained by subtracting an average value of an error between the value of the data defined as an estimation result and the actual value of the data, which could occurs due to the low order bits not extracted at the moment of obtaining the bit sequence, from a difference between the value of the predetermined data expressive of the estimated image frame of the first image and the value of data equivalent to said estimated data in a second image, estimating a difference between said first image and said second image. ### Claim 8 An image quality evaluation method of evaluating an image quality of an image, comprising: for predetermined data expressive of an image frame of a first image, extracting continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; based upon the value that is expressed with extracted bit sequences, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimating a difference between said first image and said second image, thereby to evaluate the image quality of said first image or second image; and wherein an image sending apparatus for transmitting said encoded image extracts, for the predetermined data expressive of the image frame of the original image, predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data; and wherein said image sending apparatus transmits the value being expressed with the extracted bit sequences as a feature of said original image to an image reception apparatus, being a transmission destination of said encoded image; and wherein said image reception apparatus for obtaining the transmitted image by receiving and decoding the encoded image estimates a difference between the original image and the transmitted image based upon said value that is expressed with the extracted bit sequences, said value received as a feature of said original image, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in the image frame of the transmitted image, thereby to evaluate the image quality of the transmitted image. ### Claim 9 An image quality evaluation method of evaluating an image quality of an image, comprising: for predetermined data expressive of an image frame of a first image, extracting continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; based upon the value that is expressed with extracted bit sequences, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimating a difference between said first image and said second image, thereby to evaluate the image quality of said first or second image; and wherein an image reception apparatus for obtaining the transmitted image by receiving and decoding the encoded image extracts, for the predetermined data expressive of the image frame of the transmitted image, predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data; wherein said image reception apparatus transmits the value being expressed with the extracted bit sequences as a feature of said transmitted image to an image sending apparatus, being a transmission source of said encoded image; and wherein said image sending apparatus estimates a difference between the original image and the transmitted image based upon said value that is expressed with the extracted bit sequences, said value received as a feature of said transmitted image, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in the image frame of the original image, thereby to evaluate the image quality of the transmitted image. ### Claim 10 An image quality evaluation method of evaluating an image quality of an image, comprising: for predetermined data expressive of an image frame of a first image, extracting continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; based upon the value that is expressed with extracted bit sequences, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimating a difference between said first image and said second image, thereby to evaluate the image quality of said first image or second image; and wherein an image sending apparatus for transmitting the encoded image extracts, for the predetermined data expressive of the image frame of a decoded image that is obtained by decoding the encoded image, which is obtained before transmission, predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data; wherein said image sending apparatus transmits the value being expressed with the extracted bit sequences as a feature of said decoded image to an image reception apparatus, being a transmission destination of said encoded image; and wherein said image reception apparatus for obtaining the transmitted image by receiving and decoding the encoded image estimates a difference between the decoded image and the transmitted image based upon said value that is expressed with the extracted bit sequences, said value received as a feature of said decoded image, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in the image frame of the transmitted image, thereby to evaluate the image quality of the transmitted image. ### Claim 11 An image quality evaluation method of evaluating an image quality of an image, comprising: for predetermined data expressive of an image frame of a first image, extracting continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; based upon the value that is expressed with extracted bit sequences, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimating a difference between said first image and said second image, thereby to evaluate the image quality of said first image or second image; and wherein an image sending apparatus for transmitting the encoded image extracts, for the predetermined data expressive of the image frame of a locally-decoded image that is obtained in a course of encoding the original image, predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data; wherein said image sending apparatus transmits the value being expressed with the extracted bit sequences as a feature of said locally-decoded image to an image reception apparatus, being a transmission destination of said encoded image; and wherein said image reception apparatus for obtaining the transmitted image by receiving and decoding the encoded image estimates a difference between the locally-decoded image and the transmitted image based upon said value that is expressed with the extracted bit sequences, said value received as a feature of said locally-decoded image, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in the image frame of the transmitted image, thereby to evaluate the image quality of the transmitted image. ### Claim 12 An image quality evaluation method of evaluating an image quality of an image, comprising: for predetermined data expressive of an image frame of a first image, extracting continuous predetermined bits of which a bit number is fewer than the bit number necessary for expressing the above data per one piece of data except for predetermined high order bits and predetermined low order bits of the above data; based upon the value that is expressed with extracted bit sequences, and the value of data equivalent to the data that has become a target of extracting the above bit sequences in a second image, estimating a difference between said first image and said second image, thereby to evaluate the image quality of said first image or second image; and complementing, for the extracted bit sequence, the bits not extracted at the moment of obtaining the above bit sequence, thereby to estimate the value of the predetermined data expressive of the image frame of the first image that has become a target of extracting the above bit sequence; and estimating a difference between said first image and said second image from a difference between the value of the predetermined data expressive of the image frame of the estimated first image, and the value of data equivalent to said estimated data in the image frame of the second image. ### Claim 13 (depends on 12) An image quality evaluation method according to claim 12, comprising complementing, for the extracted bit sequence, the bits not extracted at the moment of obtaining the above bit sequence with a pre-decided value, thereby to estimate the value of the predetermined data expressive of the image frame of the first image that has become a target of extracting the above bit sequence. ### Claim 14 (depends on 12) An image quality evaluation method according to claim 12, comprising complementing, for the extracted bit sequence, the bits not extracted at the moment of obtaining the above bit sequence with the value of data equivalent to the data that has become a target of extracting the above bit sequence in the second image, thereby to estimate the value of the predetermined data expressive of the image frame of the first image that has become a target of extracting the above bit sequence.