# US 9,438,920 B2 · Picture encoding method, picture encoding apparatus, picture decoding method and picture decoding apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,438,920 B2 - Document ID: US9438920B2 - Status: Granted - Kind: B2 - Application number: 14/886,271 - Filed: 2015-10-19 - Published: 2016-05-19 - Granted: 2016-09-06 - Earliest claimed: 2014-11-13 - Assignees: Fujitsu Limited - Applicants: Fujitsu Limited - Inventors: Miwa Shimada - Web page: https://patentgrep.com/patent/US9438920B2 ## CPC - H04N 19/186: the unit being a colour or a chrominance component - H04N 19/117: Filters, e.g. for pre-processing or post-processing (sub-band filter banks H04N19/635) - H04N 19/14: Coding unit complexity, e.g. amount of activity or edge presence estimation (H04N19/146 takes precedence) - H04N 19/149: by estimating the code amount by means of a model, e.g. mathematical model or statistical model - H04N 19/59: involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution - H04N 19/172: the region being a picture, frame or field - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A picture encoding method includes: generating encoded data of a luminance component of a picture and encoded data of a first color difference component which has a first resolution; generating interpolated data by applying one of a plurality of upsampling filters to data obtained by decoding the encoded data of the first color difference component; calculating difference data by obtaining differences in corresponding pixels between the interpolated data and a second color difference component of the picture which has a second resolution higher than the first resolution; generating encoded data of the difference data; and generating a stream that contains filter information indicating the applied upsampling filter, the encoded data of the luminance component, the encoded data of the first color difference component, and the encoded data of the difference data. ## Claims ### Claim 1 A non-transitory computer-readable recording medium having recorded thereon a picture encoding program that causes a computer to execute a process comprising: encoding a luminance component of a picture and a first color difference component of the picture which has a first resolution to generate encoded data of the luminance component and encoded data of the first color difference component; generating interpolated data by applying one of a plurality of upsampling filters to data obtained by decoding the encoded data of the first color difference component; calculating difference data by obtaining differences in corresponding pixels between the interpolated data and a second color difference component of the picture which has a second resolution higher than the first resolution; generating encoded data of the difference data by encoding the difference data; and generating a stream that contains filter information indicating the applied upsampling filter, the encoded data of the luminance component, the encoded data of the first color difference component, and the encoded data of the difference data. ### Claim 2 (depends on 1) The non-transitory computer-readable recording medium according to claim 1, wherein the generating the interpolated data includes applying each of the plurality of upsampling filters to the data obtained by decoding the encoded data of the first color difference component to generate the interpolated data for each of the plurality of upsampling filters, the generating the difference data includes calculating the difference data for each of the interpolated data corresponding to the plurality of upsampling filters, and the generating the encoded data of the difference data includes generating the encoded data of each of the difference data corresponding to the plurality of upsampling filters, and wherein the process further comprises selecting as the upsampling filter to be applied an upsampling filter that minimizes the amount of coding of the corresponding difference data among the plurality of upsampling filters. ### Claim 3 (depends on 1) The non-transitory computer-readable recording medium according to claim 1, wherein the process further comprises calculating the degree of complexity of the picture and, based on the degree of complexity, selecting the upsampling filter to be applied from among the plurality of upsampling filters. ### Claim 4 (depends on 3) The non-transitory computer-readable recording medium according to claim 3, wherein the selecting the upsampling filter to be applied includes, based on the degree of complexity, selecting the upsampling filter to be applied by referring to a table that provides a mapping between the degree of complexity and the upsampling filter to be selected from among the plurality of upsampling filters. ### Claim 5 A picture encoding method comprising: encoding, by a processor, a luminance component of a picture and a first color difference component of the picture which has a first resolution to generate encoded data of the luminance component and encoded data of the first color difference component; generating, by the processor, interpolated data by applying one of a plurality of upsampling filters to data obtained by decoding the encoded data of the first color difference component; calculating, by the processor, difference data by obtaining differences in corresponding pixels between the interpolated data and a second color difference component of the picture which has a second resolution higher than the first resolution; generating, by the processor, encoded data of the difference data by encoding the difference data; and generating, by the processor, a stream that contains filter information indicating the applied upsampling filter, the encoded data of the luminance component, the encoded data of the first color difference component, and the encoded data of the difference data. ### Claim 6 (depends on 5) The picture encoding method according to claim 5, wherein the generating the interpolated data includes applying each of the plurality of upsampling filters to the data obtained by decoding the encoded data of the first color difference component to generate the interpolated data for each of the plurality of upsampling filters, the generating the difference data includes calculating the difference data for each of the interpolated data corresponding to the plurality of upsampling filters, and the generating the encoded data of the difference data includes generating the encoded data of each of the difference data corresponding to the plurality of upsampling filters, and wherein the picture encoding method further comprises selecting, by the processor, as the upsampling filter to be applied an upsampling filter that minimizes the amount of coding of the corresponding difference data among the plurality of upsampling filters. ### Claim 7 (depends on 5) The picture encoding method according to claim 5, further comprising calculating, by the processor, the degree of complexity of the picture and, based on the degree of complexity, selecting the upsampling filter to be applied from among the plurality of upsampling filters. ### Claim 8 (depends on 7) The picture encoding method according to claim 7, wherein the selecting the upsampling filter to be applied includes, based on the degree of complexity, selecting the upsampling filter to be applied by referring to a table that provides a mapping between the degree of complexity and the upsampling filter to be selected from among the plurality of upsampling filters. ### Claim 9 A picture encoding apparatus comprising: a processor configured to: encode a luminance component of a picture, a first color difference component of the picture, and difference data for the picture to generate encoded data of the luminance component, encoded data of the first color difference component which has a first resolution, and encoded data of the difference data which has a second resolution higher than the first resolution; generate interpolated data by applying one of a plurality of upsampling filters to data obtained by decoding the encoded data of the first color difference component; calculate the difference data by obtaining differences in corresponding pixels between the interpolated data and a second color difference component of the picture which has the second resolution; and generate a stream that contains filter information indicating the applied upsampling filter, the encoded data of the luminance component, the encoded data of the first color difference component, and the encoded data of the difference data. ### Claim 10 (depends on 9) The picture encoding apparatus according to claim 9, wherein the generating the interpolated data includes applying each of the plurality of upsampling filters to the data obtained by decoding the encoded data of the first color difference component to generate the interpolated data for each of the plurality of upsampling filters, the generating the difference data includes calculating the difference data for each of the interpolated data corresponding to the plurality of upsampling filters, and the generating the encoded data of the difference data includes generating the encoded data of each of the difference data corresponding to the plurality of upsampling filters, and wherein the processor further configured to select as the upsampling filter to be applied an upsampling filter that minimizes the amount of coding of the corresponding difference data among the plurality of upsampling filters. ### Claim 11 (depends on 9) The picture encoding apparatus according to claim 9, wherein the processor further configured to calculate the degree of complexity of the picture and, based on the degree of complexity, select the upsampling filter to be applied from among the plurality of upsampling filters. ### Claim 12 (depends on 11) The picture encoding apparatus according to claim 11, wherein the selecting the upsampling filter to be applied includes, based on the degree of complexity, selecting the upsampling filter to be applied by referring to a table that provides a mapping between the degree of complexity and the upsampling filter to be selected from among the plurality of upsampling filters. ### Claim 13 A non-transitory computer-readable recording medium having recorded thereon a picture decoding program that causes a computer to execute a process comprising: decoding a luminance component of a picture, a first color difference component of the picture which has a first resolution, and difference data for the picture from a stream that contains encoded data of the luminance component, encoded data of the first color difference component, filter information indicating an upsampling filter applied to the first color difference component among a plurality of upsampling filters, and encoded data of the difference data which has a second resolution higher than the first resolution; generating interpolated data having the second resolution by applying the upsampling filter indicated by the filter information to the decoded first color difference component; and obtaining a sum of corresponding pixels between the interpolated data and the difference data to decode a second color difference component of the picture which has the second resolution. ### Claim 14 A picture decoding method comprising: decoding, by a processor, a luminance component of a picture, a first color difference component of the picture which has a first resolution, and difference data for the picture from a stream that contains encoded data of the luminance component, encoded data of the first color difference component, filter information indicating an upsampling filter applied to the first color difference component among a plurality of upsampling filters, and encoded data of the difference data which has a second resolution higher than the first resolution; generating, by the processor, interpolated data having the second resolution by applying the upsampling filter indicated by the filter information to the decoded first color difference component; and obtaining, by the processor, a sum of corresponding pixels between the interpolated data and the difference data to decode a second color difference component of the picture which has the second resolution. ### Claim 15 A picture decoding apparatus comprising: a processor configured to: decode a luminance component of a picture, a first color difference component of the picture which has a first resolution, and difference data for the picture from a stream that contains encoded data of the luminance component, encoded data of the first color difference component, filter information indicating an upsampling filter applied to the first color difference component among a plurality of upsampling filters, and encoded data of the difference data which has a second resolution higher than the first resolution; generate interpolated data having the second resolution by applying the upsampling filter indicated by the filter information to the decoded first color difference component; and obtain a sum of corresponding pixels between the interpolated data and the difference data to decode a second color difference component of the picture which has the second resolution.