# US 2018/0025477 A1 · Metadata-based image processing method and apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2018/0025477 A1 - Document ID: US20180025477A1 - Status: Published application - Kind: A1 - Application number: 15/550,941 - Filed: 2016-01-28 - Published: 2018-01-25 - Earliest claimed: 2015-02-16 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Byung-seok MIN; Tae-gyu LIM; Seung-hoon HAN; Ho-cheon WEY - Web page: https://patentgrep.com/patent/US20180025477A1 ## CPC - H04N 9/68: for controlling the amplitude of colour signals, e.g. automatic chroma control circuits (H04N9/71, H04N9/73 take precedence; camera processing pipelines for controlling the colour saturation of colour signals H04N23/86) - G06T 5/90: Dynamic range modification of images or parts thereof - G06T 5/92: based on global image properties - G06T 7/90: Determination of colour characteristics - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 11/60: Creating or editing images; Combining images with text - G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} - H04N 1/6027: {Correction or control of colour gradation or colour contrast (H04N1/6058 takes precedence)} - H04N 1/6058: {Reduction of colour to a range of reproducible colours, e.g. to ink- reproducible colour gamut} - H04N 9/67: for matrixing (camera processing pipelines for matrixing of colour signals H04N23/85) - H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal} - G06T 7/194: involving foreground-background segmentation - G06T 2207/10024: Color image - G06T 2207/20208: High dynamic range [HDR] image processing - G06T 2210/12: Bounding box - G09G 2320/0271: Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping - G09G 2340/06: Colour space transformation - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract Disclosed are a method and apparatus for generating local metadata including position information of a similar color mapping region and a color mapping function of the similar color mapping region and a method and apparatus for correcting color components of a pixel in a similar color mapping region based on local metadata. ## Claims ### Claim 1 A metadata generation method comprising: splitting a first image into a plurality of regions based on spatial proximity and color similarity of pixels included in the first image; acquiring a color mapping function of a first region among the plurality of regions by comparing color information of pixels in the first region with color information of pixels in a second image, which correspond to the pixels in the first region; acquiring a color mapping function of a second region among the plurality of regions by comparing color information of pixels in the second region with color information of pixels in the second image, which correspond to the pixels in the second region; setting the first region and the second region as a similar color mapping region by comparing the color mapping function of the first region with the color mapping function of the second region; acquiring a color mapping function of the similar color mapping region based on the color mapping function of the first region and the color mapping function of the second region; and generating local metadata including position information of the similar color mapping region in the first image and the color mapping function of the similar color mapping region. ### Claim 2 (depends on 1) The metadata generation method of claim 1, wherein the first image is split into a foreground region and a background region based on a background model learned in a time axis, and the plurality of regions are split from the foreground region and the background region. ### Claim 3 (depends on 1) The metadata generation method of claim 1, wherein the first region and the second region are spatially adjacent. ### Claim 4 (depends on 3) The metadata generation method of claim 3, further comprising: acquiring a color mapping function of a third region, which is adjacent to the second region, among the plurality of regions by comparing color information of pixels in the third region with color information of pixels in the second image, which correspond to the pixels in the third region; and setting the first region through the third region as the similar color mapping region or setting the third region as a new similar color mapping region, by comparing the color mapping function of the similar color mapping region with the color mapping function of the third region. ### Claim 5 (depends on 1) The metadata generation method of claim 1, wherein the position information of the similar color mapping region comprises an upper left corner coordinate (x, y) and a right lower corner coordinate (x, y) of at least one bounding box with respect to the similar color mapping region. ### Claim 6 (depends on 1) The metadata generation method of claim 1, wherein the position information of the similar color mapping region comprises at least one coordinate (x, y) of a bounding box and size information of the bounding box with respect to the similar color mapping region. ### Claim 7 (depends on 1) The metadata generation method of claim 1, further comprising: generating static metadata including gamut information of the second image; and correcting a color gamut of the first image based on the gamut information of the second image, wherein the plurality of regions are split from the gamut-corrected first image. ### Claim 8 (depends on 7) The metadata generation method of claim 7, further comprising: acquiring a tone mapping function between the gamut-corrected first image and the second image based on a luminance value of pixels included in the gamut-corrected first image and a luminance value of pixels included in the second image; performing tone mapping on the gamut-corrected first image based on the tone mapping function; and generating global metadata including the tone mapping function, wherein the plurality of regions are split from the tone-mapped first image. ### Claim 9 (depends on 8) The metadata generation method of claim 8, further comprising: acquiring a saturation correction function between the tone-mapped first image and the second image based on a saturation value of pixels included in the tone-mapped first image and a saturation value of the pixels included in the second image; and performing saturation correction on the tone-mapped first image based on the saturation correction function, wherein the global metadata further comprises the saturation correction function, and the plurality of regions are split from the saturation-corrected first image. ### Claim 10 An image processing method comprising: receiving local metadata including position information of a similar color mapping region in a first image and a color mapping function of the similar color mapping region; restoring the similar color mapping region in the first image based on the position information of the similar color mapping region; and correcting color components of pixels in the restored similar color mapping region based on the color mapping function of the similar color mapping region. ### Claim 11 (depends on 10) The image processing method of claim 10, wherein the position information of the similar color mapping region comprises an upper left corner coordinate (x, y) and a right lower corner coordinate (x, y) of a bounding box with respect to the similar color mapping region. ### Claim 12 (depends on 10) The image processing method of claim 10, wherein the position information of the similar color mapping region comprises at least one coordinate (x, y) of a bounding box and size information of the bounding box with respect to the similar color mapping region. ### Claim 13 (depends on 10) The image processing method of claim 10, further comprising: receiving static metadata including gamut information of a second image; and correcting a color gamut of the first image based on the gamut information of the second image, wherein the similar color mapping region is restored from the gamut-corrected first image. ### Claim 14 (depends on 13) The image processing method of claim 13, further comprising: receiving global metadata including a tone mapping function between the gamut-corrected first image and the second image; and performing tone mapping on the gamut-corrected first image based on the tone mapping function, wherein the similar color mapping region is restored from the tone-mapped first image. ### Claim 15 (depends on 14) The image processing method of claim 14, further comprising performing saturation correction on the tone-mapped first image based on a saturation correction function between the tone-mapped first image and the second image, which is included in the global metadata, wherein the similar color mapping region is restored from the saturation-corrected first image. ### Claim at position 16 -24. (canceled) ### Claim 25 An image decoding apparatus comprising: a communicator configured to receive local metadata including position information of a similar color mapping region in a first image and a color mapping function of the similar color mapping region; a processor configured to restore the similar color mapping region in the first image based on the position information of the similar color mapping region; and correct color components of pixels in the restored similar color mapping region based on the color mapping function of the similar color mapping region. ### Claim 26 (depends on 25) The image decoding apparatus of claim 25, wherein the position information of the similar color mapping region comprises an upper left corner coordinate (x, y) and a right lower corner coordinate (x, y) of a bounding box with respect to the similar color mapping region. ### Claim 27 (depends on 25) The image decoding apparatus of claim 25, wherein the position information of the similar color mapping region comprises at least one coordinate (x, y) of a bounding box and size information of the bounding box with respect to the similar color mapping region. ### Claim 28 (depends on 25) The image decoding apparatus of claim 25, wherein the processor configured to correct a color gamut of the first image based on static metadata including gamut information of a second image, which has been received by the communicator, wherein the similar color mapping region is restored from the gamut-corrected first image. ### Claim 29 (depends on 28) The image decoding apparatus of claim 28, wherein the processor configured to perform tone mapping on the gamut-corrected first image based on global metadata including a tone mapping function between the gamut-corrected first image and the second image, which has been received by the communicator, wherein the similar color mapping region is restored from the tone-mapped first image. ### Claim at position 22 -31. (canceled)