# US 12,598,264 B2 · Color correction for electronic device with immersive viewing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,598,264 B2 - Document ID: US12598264B2 - Status: Granted - Kind: B2 - Application number: 18/613,004 - Filed: 2024-03-21 - Published: 2024-12-05 - Granted: 2026-04-07 - Earliest claimed: 2023-05-31 - Assignees: Apple Inc. - Applicants: Apple Inc. - Inventors: Renbo Cao; Yonghui Zhao; Yingjun Bai; Xuemei Zhang - Web page: https://patentgrep.com/patent/US12598264B2 ## CPC - G09G 3/2003: {Display of colours (specific for liquid crystal displays G09G3/3607)} - H04N 1/60: Colour correction or control {(H04N1/54 takes precedence)} - G06T 17/00: Three-dimensional [3D] modelling for computer graphics - G06V 10/56: relating to colour - G06V 10/60: relating to illumination properties, e.g. using a reflectance or lighting model - G06F 3/147: using display panels - G09G 3/003: {to produce spatial visual effects} - G09G 3/3607: {for displaying colours or for displaying grey scales with a specific pixel layout, e.g. using sub-pixels (display of colours in flat matrix panels other than liquid crystal displays G09G3/2003; grey scales specific for television H04N3/127)} - G09G 5/02: characterised by the way in which colour is displayed {(details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607)} - G09G 2320/0666: for control of colour parameters, e.g. colour temperature - G09G 2360/144: the light being ambient light - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract An electronic device is provided that includes one or more image sensors configured to capture a video feed, an image signal processor configured to perform color correction on the captured video feed based on a brightness level computed from the captured video feed and/or based on a color temperature or illuminant type of the lighting in the captured video feed to generate a corresponding color corrected video feed using a first chromatic adaptation model that is adapted to an immersive viewing condition, and one or more displays configured to output the color corrected video feed. The electronic device can further include a recording pipeline configured to record a version of the captured video feed and can share or transmit the recorded content to an external device. The external device can display the recorded content using a second chromatic adaptation model that is adapted to a non-immersive viewing condition. ## Claims ### Claim 1 A method of operating an electronic device having one or more image sensors and one or more displays, the method comprising: capturing a video feed using the one or more image sensors; performing color correction on the captured video feed based on a brightness level computed from the captured video feed and a first chromatic adaptation model adapted to an immersive viewing condition to generate a corresponding color corrected video feed adapted to the immersive viewing condition, wherein the first chromatic adaptation model is a function of a peak brightness level of the one or more displays; outputting the color corrected video feed using the one or more displays of the electronic device; recording a version of the captured video feed; and sending the recorded version of the captured video feed to an external electronic device, wherein the external electronic device is configured to display the recorded version of the captured video feed that is color corrected using a second chromatic adaptation model adapted to a non-immersive viewing condition. ### Claim 2 (depends on 1) The method of claim 1, further comprising: computing the brightness level using calibrated linear camera signals in the electronic device. ### Claim 3 (depends on 2) The method of claim 2, further comprising: translating the calibrated linear camera signals to the brightness level using a linear regression model. ### Claim 4 (depends on 1) The method of claim 1, wherein: the first chromatic adaptation model adapted to the immersive viewing condition exhibits a first degree of color adaptation when the computed brightness level is at a first brightness level and exhibits a second degree of color adaptation when the computed brightness level is at a second brightness level greater than the first brightness level; and the second chromatic adaptation model adapted to the non-immersive viewing condition exhibits a third degree of color adaptation greater than the first degree of color adaptation when the computed brightness level is at the first brightness level and exhibits a fourth degree of color adaptation greater than the second degree of color adaptation when the computed brightness level of the captured video feed is at the second brightness level. ### Claim 5 (depends on 1) The method of claim 1, further comprising: receiving content from another external electronic device; and outputting the received content using the one or more displays that is color corrected using the first chromatic adaptation model adapted to the immersive viewing condition. ### Claim 6 (depends on 1) The method of claim 1, further comprising: rendering virtual content; performing color correction on the virtual content using the first chromatic adaptation model adapted to the immersive viewing condition to generate corresponding color corrected virtual content; merging the color corrected video feed with the color corrected virtual content to create a merged video feed; and outputting the merged video feed using the one or more displays for immersive viewing. ### Claim 7 (depends on 1) The method of claim 1, further comprising: rendering virtual content; modifying the captured video feed using an inverted version of the first chromatic adaptation model to generate a corresponding modified video feed; merging the modified video feed with the virtual content to create a merged video feed; and outputting the merged video feed using the one or more displays for immersive viewing. ### Claim 8 (depends on 1) The method of claim 1, further comprising: performing color correction on the captured video feed based on a color temperature or an illuminant type of lighting in the captured video feed. ### Claim 9 A method of operating an electronic device having one or more image sensors and one or more displays, the method comprising: capturing a video feed using the one or more image sensors; performing color correction on the captured video feed based on a color temperature or illuminant type of lighting in the captured video feed and a first chromatic adaptation model that is a function of a peak brightness level of the one or more displays to generate a corresponding color corrected video feed that is adapted to an immersive viewing condition; outputting the color corrected video feed using the one or more displays of the electronic device; recording a version of the captured video feed; and sending the recorded version of the captured video feed to an external electronic device, wherein the external electronic device is configured to display the recorded version of the captured video feed that is color corrected using a second chromatic adaptation model adapted to a non-immersive viewing condition. ### Claim 10 (depends on 9) The method of claim 9, further comprising: performing color correction on the captured video feed based on a brightness level computed from the captured video feed. ### Claim 11 (depends on 9) The method of claim 9, wherein: the first chromatic exhibits a first degree of color adaptation when the color temperature of the captured video feed is at a first value and exhibits a second degree of color adaptation when the color temperature of the captured video feed is at a second value greater than the first value; and the second chromatic adaptation model exhibits a third degree of color adaptation greater than the first degree of color adaptation when the color temperature of the captured video feed is at the first value and exhibits a fourth degree of color adaptation greater than the second degree of color adaptation when the color temperature of the captured video feed is at the second value. ### Claim 12 (depends on 9) The method of claim 9, further comprising: receiving content from another external electronic device; and outputting the received content using the one or more displays that has been color corrected using the first chromatic adaptation model. ### Claim 13 A method comprising: with one or more image sensors, capturing a video feed; rendering the video feed using a chromatic adaptation matrix adapted to an immersive viewing condition, wherein the chromatic adaptation matrix is a function of a brightness level of the captured video feed and a peak display brightness; recording a version of the captured video feed; modifying the chromatic adaptation matrix to produce a modified chromatic adaptation matrix adapted to a non-immersive viewing condition; rendering the recorded version of the captured video feed using the modified chromatic adaptation matrix adapted to the non-immersive viewing condition to produce a color corrected video feed; and with one or more displays, outputting the color corrected video feed. ### Claim 14 (depends on 13) The method of claim 13, further comprising: generating the chromatic adaptation matrix based on a color temperature of ambient light in the captured video feed. ### Claim 15 (depends on 13) The method of claim 13, further comprising: detecting a type of light source in the captured video feed; and generating the chromatic adaptation matrix based on the detected type of light source in the captured video feed. ### Claim 16 A method comprising: with one or more image sensors, capturing a video feed; rendering the captured video feed using a chromatic adaptation matrix adapted to a non-immersive viewing condition, wherein the chromatic adaptation matrix is a function of a brightness level of the captured video feed and a peak display brightness; recording a version of the captured video feed; modifying the chromatic adaptation matrix to produce a modified chromatic adaptation matrix adapted to an immersive viewing condition; rendering the recorded version of the captured video feed using the modified chromatic adaptation matrix adapted to the immersive viewing condition to produce a color corrected video feed; and with one or more displays, outputting the color corrected video feed.