# US 10,319,085 B2 · Metadata-based image processing method and apparatus > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,319,085 B2 - Document ID: US10319085B2 - Status: Granted - Kind: B2 - Application number: 15/550,941 - Filed: 2016-01-28 - Published: 2018-01-25 - Granted: 2019-06-11 - Earliest claimed: 2015-02-16 - Assignees: Samsung Electronics Co., Ltd. - Applicants: Samsung Electronics Co., Ltd. - Inventors: Byung-seok Min; Tae-gyu Lim; Seung-hoon Han; Ho-cheon Wey - Web page: https://patentgrep.com/patent/US10319085B2 ## CPC - H04N 9/68: for controlling the amplitude of colour signals, e.g. automatic chroma control circuits (H04N9/71, H04N9/73 take precedence; camera processing pipelines for controlling the colour saturation of colour signals H04N23/86) - G06T 5/90: Dynamic range modification of images or parts thereof - G06T 5/92: based on global image properties - G06T 7/90: Determination of colour characteristics - G06T 11/10: Texturing; Colouring; Generation of textures or colours (retouching, inpainting or scratch removal G06T5/77) - G06T 11/60: Creating or editing images; Combining images with text - G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} - H04N 1/6027: {Correction or control of colour gradation or colour contrast (H04N1/6058 takes precedence)} - H04N 1/6058: {Reduction of colour to a range of reproducible colours, e.g. to ink- reproducible colour gamut} - H04N 9/67: for matrixing (camera processing pipelines for matrixing of colour signals H04N23/85) - H04N 9/8205: {involving the multiplexing of an additional signal and the colour video signal} - G06T 7/194: involving foreground-background segmentation - G06T 2207/10024: Color image - G06T 2207/20208: High dynamic range [HDR] image processing - G06T 2210/12: Bounding box - G09G 2320/0271: Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping - G09G 2340/06: Colour space transformation - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract Disclosed are a method and apparatus for generating local metadata including position information of a similar color mapping region and a color mapping function of the similar color mapping region and a method and apparatus for correcting color components 5 of a pixel in a similar color mapping region based on local metadata. ## Claims ### Claim 1 A metadata generation method comprising: acquiring at least one of a tone mapping function and a saturation correction function between a first image and a second image based on pixels included in the first image and pixels included in the second image; correcting the first image by performing the at least one of the tone mapping function and the saturation correction function on the first image; generating global metadata including the at least one of the tone mapping function and the saturation correction function; splitting the corrected first image into a plurality of regions based on spatial proximity and color similarity of pixels included in the corrected first image; acquiring a color mapping function of a first region among the plurality of regions by comparing color information of pixels in the first region with color information of pixels in the second image, which correspond to the pixels in the first region; acquiring a color mapping function of a second region among the plurality of regions by comparing color information of pixels in the second region with color information of pixels in the second image, which correspond to the pixels in the second region; setting the first region and the second region as a similar color mapping region by comparing the color mapping function of the first region with the color mapping function of the second region; acquiring a color mapping function of the similar color mapping region based on the color mapping function of the first region and the color mapping function of the second region; and generating local metadata including position information of the similar color mapping region in the corrected first image and the color mapping function of the similar color mapping region. ### Claim 2 (depends on 1) The metadata generation method of claim 1, wherein the corrected first image is split into a foreground region and a background region based on a background model learned in a time axis, and the plurality of regions are split from the foreground region and the background region. ### Claim 3 (depends on 1) The metadata generation method of claim 1, wherein the first region and the second region are spatially adjacent. ### Claim 4 (depends on 3) The metadata generation method of claim 3, further comprising: acquiring a color mapping function of a third region, which is adjacent to the second region, among the plurality of regions by comparing color information of pixels in the third region with color information of pixels in the second image, which correspond to the pixels in the third region; and setting the first region through the third region as the similar color mapping region or setting the third region as a new similar color mapping region, by comparing the color mapping function of the similar color mapping region with the color mapping function of the third region. ### Claim 5 (depends on 1) The metadata generation method of claim 1, wherein the position information of the similar color mapping region comprises an upper left corner coordinate (x, y) and a right lower corner coordinate (x, y) of at least one bounding box with respect to the similar color mapping region. ### Claim 6 (depends on 1) The metadata generation method of claim 1, wherein the position information of the similar color mapping region comprises at least one coordinate (x, y) of a bounding box and size information of the bounding box with respect to the similar color mapping region. ### Claim 7 (depends on 1) The metadata generation method of claim 1, further comprising: generating static metadata including gamut information of the second image; and correcting a color gamut of the first image based on the gamut information of the second image, wherein the acquiring of the at least one of the tone mapping function and the saturation correction function comprises: acquiring the at least one of the tone mapping function and the saturation correction function based on pixels included in the gamut-corrected first image and pixels included in the second image. ### Claim 8 (depends on 1) The metadata generation method of claim 1, further comprising: generating static metadata including gamut information of the second image; and correcting a color gamut of the first image based on the gamut information of the second image, wherein the acquiring of the at least one of the tone mapping function and the saturation correction function comprises: acquiring a tone mapping function between the gamut-corrected first image and the second image based on a luminance value of pixels included in the gamut-corrected first image and a luminance value of pixels included in the second image, wherein the correcting of the first image by performing the at least one of the tone mapping function and the saturation correction function on the first image comprises: performing tone mapping on the gamut-corrected first image based on the tone mapping function, wherein the global metadata includes the tone mapping function, and the plurality of regions are split from the tone-mapped first image. ### Claim 9 (depends on 8) The metadata generation method of claim 8, wherein the acquiring of the at least one of the tone mapping function and the saturation correction function further comprises: acquiring a saturation correction function between the tone-mapped first image and the second image based on a saturation value of pixels included in the tone-mapped first image and a saturation value of the pixels included in the second image; and performing saturation correction on the tone-mapped first image based on the saturation correction function, wherein the global metadata further comprises the saturation correction function, and the plurality of regions are split from the saturation-corrected first image. ### Claim 10 An image processing method comprising: receiving global metadata including at least one of a tone mapping function and a saturation correction function between a first image and a second image; correcting the first image by performing the at least one of the tone mapping function and the saturation correction function on the first image; receiving local metadata including position information of a similar color mapping region in the corrected first image and a color mapping function of the similar color mapping region; restoring the similar color mapping region in the corrected first image based on the position information of the similar color mapping region; and correcting color components of pixels in the restored similar color mapping region based on the color mapping function of the similar color mapping region. ### Claim 11 (depends on 10) The image processing method of claim 10, wherein the position information of the similar color mapping region comprises an upper left corner coordinate (x, y) and a right lower corner coordinate (x, y) of a bounding box with respect to the similar color mapping region. ### Claim 12 (depends on 10) The image processing method of claim 10, wherein the position information of the similar color mapping region comprises at least one coordinate (x, y) of a bounding box and size information of the bounding box with respect to the similar color mapping region. ### Claim 13 (depends on 10) The image processing method of claim 10, further comprising: receiving static metadata including gamut information of the second image; and correcting a color gamut of the first image based on the gamut information of the second image, wherein the correcting of the first image comprises correcting the gamut-corrected first image by performing the at least one of the tone mapping function and the saturation correction function on the gamut-corrected first image. ### Claim 14 (depends on 10) The image processing method of claim 10, further comprising: receiving static metadata including gamut information of the second image; and correcting a color gamut of the first image based on the gamut information of the second image, wherein the receiving of the global metadata comprises receiving the global metadata including the tone mapping function between the gamut-corrected first image and the second image, wherein the correcting of the first image by performing the at least one of the tone mapping function and the saturation correction function comprise: performing tone mapping on the gamut-corrected first image based on the tone mapping function, and the similar color mapping region is restored from the tone-mapped first image. ### Claim 15 (depends on 14) The image processing method of claim 14, wherein the correcting of the first image by performing the at least one of the tone mapping function and the saturation correction function further comprises performing saturation correction on the tone-mapped first image based on a saturation correction function between the tone-mapped first image and the second image, which is included in the global metadata, wherein the similar color mapping region is restored from the saturation-corrected first image. ### Claim 16 An image decoding apparatus comprising: a communicator configured to receive a first image, local metadata, and global metadata; and a processor configured to: receive global metadata including at least one of a tone mapping function and a saturation correction function between the first image and a second image, correct the first image by performing the at least one of the tone mapping function and the saturation correction function on the first image, receive the local metadata including position information of a similar color mapping region in the corrected first image and a color mapping function of the similar color mapping region, restore the similar color mapping region in the corrected first image based on the position information of the similar color mapping region; and correct color components of pixels in the restored similar color mapping region based on the color mapping function of the similar color mapping region. ### Claim 17 (depends on 16) The image decoding apparatus of claim 16, wherein the position information of the similar color mapping region comprises an upper left corner coordinate (x, y) and a right lower corner coordinate (x, y) of a bounding box with respect to the similar color mapping region. ### Claim 18 (depends on 16) The image decoding apparatus of claim 16, wherein the position information of the similar color mapping region comprises at least one coordinate (x, y) of a bounding box and size information of the bounding box with respect to the similar color mapping region. ### Claim 19 (depends on 16) The image decoding apparatus of claim 16, wherein the processor configured to correct a color gamut of the first image based on static metadata including gamut information of the second image, which has been received by the communicator, and correct the gamut-corrected first image by performing the at least one of the tone mapping function and the saturation correction function on the gamut-corrected first image. ### Claim 20 (depends on 19) The image decoding apparatus of claim 19, wherein the processor configured to perform tone mapping on the gamut-corrected first image based on global metadata including the tone mapping function between the gamut-corrected first image and the second image, which has been received by the communicator, wherein the similar color mapping region is restored from the tone-mapped first image.