# US 10,504,484 B2 · Information processing apparatus, information recording medium, image processing method, and program for converting a color space of an image > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,504,484 B2 - Document ID: US10504484B2 - Status: Granted - Kind: B2 - Application number: 15/127,922 - Filed: 2015-04-20 - Published: 2017-04-06 - Granted: 2019-12-10 - Earliest claimed: 2014-04-30 - Assignees: Sony Corporation - Applicants: Sony Corporation - Inventors: Kazuo Yamamoto; Shinobu Hattori - Web page: https://patentgrep.com/patent/US10504484B2 ## CPC - G09G 5/06: using colour palettes, e.g. look-up tables - G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} - G09G 5/026: {Control of mixing and/or overlay of colours in general (G09G5/022 and G09G5/024 take precedence)} - H04N 1/6072: {adapting to different types of images, e.g. characters, graphs, black and white image portions} - H04N 9/67: for matrixing (camera processing pipelines for matrixing of colour signals H04N23/85) - H04N 9/76: for mixing of colour signals (H04N9/75 takes precedence) - H04N 11/24: High-definition television systems - G09G 2340/06: Colour space transformation - G09G 2340/10: Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels - G09G 2340/125: wherein one of the images is motion video - H04N 21/42646: {for reading from or writing on a non-volatile solid state storage medium, e.g. DVD, CD-ROM} - H04N 21/42653: {for processing graphics} - H04N 21/4312: {involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations} - H04N 21/4325: {by playing back content from the storage medium (reproduction of recorded television signals H04N5/76; reproduction of recorded television signals H04N9/79)} - H04N 21/4884: {for displaying subtitles} - H04N 21/6125: {involving transmission via Internet (transmission by internet of broadcast information H04H60/82)} - H04N 2201/0089: Image display device - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract An information processing apparatus may include circuitry configured to: receive a first image (201), a second image (202) and first color space information (BT.2020) indicating a first color space of the first image; convert a second color space (BT.709) of the second image to a converted color space (BT.2020) same as the first color space, when the second color space is different from the first color space; and generate a display image (209) including the first image and the second image having the converted color space. ## Claims ### Claim 1 An information processing apparatus comprising: circuitry configured to: receive a first image, a second image and first color space information indicating a first color space of the first image; convert a second color space of the second image to a converted color space same as the first color space, when the second color space is different from the first color space; generate a display image including the first image and the second image having the converted color space; generate a look up table that associates a palette entry identifier of a palette corresponding to the second color space of the second image with an image signal of the first color space of the first image, in which the first color space of the first image has a first color area and the second color space of the second image has a second color area different from the first color area, and in which the look up table is generated from a second look up table having correspondence data between a second palette entry identifier corresponding to the second color space and a second image signal in the second color space by performing a color space conversion on the second look up table whereby the look up table has a color area that is different from a color area of the second look up table, the color space conversion on the second look up table comprising, for each of a plurality of second color space values in the second color space, rewriting the second color space value as a first color space value, and associating with the first color space value the second palette entry identifier provided in the second look up table for the second color space value, so as to generate the look up table comprising a plurality of first color space values associated with respective second palette entry identifiers; and convert a palette entry identifier of the second image directly to an image signal for superposition having the same color area as the first color space of the first image by using the look up table. ### Claim 2 (depends on 1) The information processing apparatus according to claim 1, wherein the display image is generated by superposing the second image on the first image. ### Claim 3 (depends on 1) The information processing apparatus according to claim 1, wherein the circuitry is configured to: receive second color space information indicating the second color space of the second image, and convert the second color space of the second image based on the first color space information and the second color space information. ### Claim 4 (depends on 1) The information processing apparatus according to claim 1, wherein the circuitry is configured to determine color area of a color space of the second image based on a format of the second image. ### Claim 5 (depends on 1) The information processing apparatus according to claim 1, wherein the circuitry is configured to: control superposing the second image having a palette entry identifier of a given palette corresponding to a predetermined color space having a predetermined color area as color information on the first image, convert the palette entry identifier of the second image to an image signal corresponding to a same color space having a same color area as the given palette, and convert the image signal to another image signal for superposition having the same color area as the first color space of the first image. ### Claim 6 (depends on 1) The information processing apparatus according to claim 1, wherein the circuitry is configured to: control superposing the second image having an RGB signal corresponding to the second color space as color information on the first image. ### Claim 7 (depends on 1) The information processing apparatus according to claim 1, wherein the circuitry is configured to: control superposing the image signal for superposition on the first image. ### Claim 8 (depends on 1) The information processing apparatus according to claim 1, wherein the first color space of the first image is BT. 2020 or BT. 709, and the circuitry executes color space conversion processing to cause the second color space of the second image to coincide with the first color space of the first image. ### Claim 9 (depends on 1) The information processing apparatus according to claim 1, wherein the circuitry acquires the first color space information of the first image and second color space information of the second image from attribute information corresponding respectively to the first and second images. ### Claim 10 (depends on 1) The information processing apparatus according to claim 1, wherein the first image and the second image are image data recorded on an information recording medium, and the circuitry acquires the first color space information of the first image and second color space information of the second image from an attribute information recording file recorded on the information recording medium. ### Claim 11 (depends on 10) The information processing apparatus according to claim 10, wherein the first image and the second image are stored in a clip AV stream file or clip AV stream files, and the circuitry acquires the first color space information of the first image and second color space information of the second image from a clip information file or clip information files recorded on an information recording medium. ### Claim 12 (depends on 1) The information processing apparatus according to claim 1, wherein at least one image of the first image or the second image is data which is input from external to the information processing device via a communication unit, and wherein the circuitry acquires color space information of the at least one image from attribute information which is input from external to the information processing device. ### Claim 13 A non-transitory recording medium configured to store a program executable by a computer and first image data of a first image, first color space information indicating a first color space of the first image, and second image data of a second image; and wherein the program comprises: causing a reproduction device configured to generate a display image including the first image and the second image having a converted color space, to convert a second color space of the second image to the converted color space same as the first color space, when the second color space has a second color area different from a first color area of the first color space, in which the second color space of the second image is converted to the converted color space same as the first color space by generating a look up table that associates a palette entry identifier of a palette corresponding to the second color space of the second image with an image signal of the first color space of the first image, in which the look up table is generated from a second look up table having correspondence data between a second palette entry identifier corresponding to the second color space and a second image signal in the second color space by performing a color space conversion on the second look up table whereby the look up table has a color area that is different from a color area of the second look up table, the color space conversion on the second look up table comprising, for each of a plurality of second color space values in the second color space, rewriting the second color space value as a first color space value, and associating with the first color space value the second palette entry identifier provided in the second look up table for the second color space value, so as to generate the look up table comprising a plurality of first color space values associated with respective second palette entry identifiers, and converting a palette entry identifier of the second image directly to an image signal for superposition having the same color area as the first color space of the first image by using the look up table. ### Claim 14 (depends on 13) The non-transitory recording medium according to claim 13, wherein the display image is generated by superposing the second image on the first image. ### Claim 15 (depends on 13) The non-transitory recording medium according to claim 13, wherein the reproduction device is configured to: receive second color space information indicating the second color space of the second image, and convert the second color space of the second image based on the first color space information and the second color space information. ### Claim 16 (depends on 13) The non-transitory recording medium according to claim 13, wherein the second color space of the second image is based on a format of the second image. ### Claim 17 An image processing method comprising: receiving a first image, a second image and first color space information indicating a first color space of the first image; converting a second color space of the second image to a converted color space same as the first color space, when the second color space is different from the first color space; generating a display image including the first image and the second image having the converted color space; generating a look up table that associates a palette entry identifier of a palette corresponding to the second color space of the second image with an image signal of the first color space of the first image, in which the first color space of the first image has a first color area and the second color space of the second image has a second color area different from the first color area, and in which the look up table is generated from a second look up table having correspondence data between a second palette entry identifier corresponding to the second color space and a second image signal in the second color space by performing a color space conversion on the second look up table whereby the look up table has a color area that is different from a color area of the second look up table, the color space conversion on the second look up table comprising, for each of a plurality of second color space values in the second color space, rewriting the second color space value as a first color space value, and associating with the first color space value the second palette entry identifier provided in the second look up table for the second color space value, so as to generate the look up table comprising a plurality of first color space values associated with respective second palette entry identifiers; and converting a palette entry identifier of the second image directly to an image signal for superposition having the same color area as the first color space of the first image by using the look up table. ### Claim 18 (depends on 17) The image processing method according to claim 17, wherein the generating of the display image is by superposing the second image on the first image. ### Claim 19 (depends on 17) The image processing method according to claim 17 further comprising: receiving second color space information indicating the second color space of the second image, and converting the second color space of the second image based on the first color space information and the second color space information. ### Claim 20 (depends on 17) The image processing method according to claim 17 further comprising: determining color space of the second image based on a format of the second image. ### Claim 21 A non-transitory recording medium on which is recorded a program having instructions that, when executed by circuitry, configure the circuitry to: receive a first image, a second image and first color space information indicating a first color space of the first image; convert a second color space of the second image to a converted color space same as the first color space, when the second color space is different from the first color space; generate a display image including the first image and the second image having the converted color space; generate a look up table that associates a palette entry identifier of a palette corresponding to the second color space of the second image with an image signal of the first color space of the first image, in which the first color space of the first image has a first color area and the second color space of the second image has a second color area different from the first color area, and in which the look up table is generated from a second look up table having correspondence data between a second palette entry identifier corresponding to the second color space and a second image signal in the second color space by performing a color space conversion on the second look up table whereby the look up table has a color area that is different from a color area of the second look up table, the color space conversion on the second look up table comprising, for each of a plurality of second color space values in the second color space, rewriting the second color space value as a first color space value, and associating with the first color space value the second palette entry identifier provided in the second look up table for the second color space value, so as to generate the look up table comprising a plurality of first color space values associated with respective second palette entry identifiers; and convert a palette entry identifier of the second image directly to an image signal for superposition having the same color area as the first color space of the first image by using the look up table. ### Claim 22 (depends on 21) The non-transitory recording medium according to claim 21, wherein the display image is generated by superposing the second image on the first image. ### Claim 23 (depends on 21) The non-transitory recording medium according to claim 21, wherein, when the instructions are executed by the circuitry, the circuitry is configured to: receive second color space information indicating the second color space of the second image, and convert the second color space of the second image based on the first color space information and the second color space information. ### Claim 24 (depends on 21) The non-transitory recording medium according to claim 21, wherein, when the instructions are executed by the circuitry, the circuitry is configured to: determine color area of a color space of the second image based on a format of the second image.