# US 10,455,208 B2 · Image processing apparatus, image processing method, and non-transitory computer-readable storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,455,208 B2 - Document ID: US10455208B2 - Status: Granted - Kind: B2 - Application number: 16/149,670 - Filed: 2018-10-02 - Published: 2019-01-31 - Granted: 2019-10-22 - Earliest claimed: 2015-03-02 - Assignees: Canon Kabushiki Kaisha - Applicants: Canon Kabushiki Kaisha - Inventors: Satoshi Nakashima - Web page: https://patentgrep.com/patent/US10455208B2 ## CPC - H04N 23/88: for colour balance, e.g. white-balance circuits or colour temperature control - G02B 27/017: {Head mounted} - H04N 13/344: with head-mounted left-right displays - G02B 2027/0112: {comprising device for genereting colour display} - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G02B 2027/0187: {slaved to motion of at least a part of the body of the user, e.g. head, eye} - H04N 2209/046: Colour interpolation to calculate the missing colour values - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract A color temperature of each of a first sensed image that is sensed by a first image sensing device and a second sensed image that is sensed by a second image sensing device different from the first image sensing device is acquired, a color temperature that is common between the first image sensing device and the second image sensing device is decided based on the acquired color temperatures, and color information in an image sensed by the first image sensing device and an image sensed by the second image sensing device is adjusted based on the decided color temperature. ## Claims ### Claim 1 An image processing apparatus comprising: a processor; and a memory storing instructions which, when executed by the processor, cause the image processing apparatus to: acquire a color temperature of each of a first sensed image that is sensed by a first image sensing device and a second sensed image that is sensed by a second image sensing device different from the first image sensing device; and adjust color information of at least one of the first and the second image sensing devices so that the first and the second image sensing devices use a common color temperature which is an average color temperature of the color temperatures acquired from the first and the second image sensing devices. ### Claim 2 (depends on 1) The image processing apparatus according to claim 1, wherein the adjustment of the color information includes adjusting each of R, G, and B signals in an image sensed by the first image sensing device and an image sensed by the second image sensing device based on the common color temperature. ### Claim 3 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions, when executed by the processor, further cause the image processing apparatus to obtain a difference between a maximum color temperature and a minimum color temperature among the color temperatures acquired from the first sensed image and the second sensed image. ### Claim 4 (depends on 1) The image processing apparatus according to claim 1, wherein the acquisition of the color temperature of each of the first sensed image and the second sensed image includes: obtaining an average pixel value for each color component of the respective sensed images, and acquiring the color temperature of each of the respective sensed images using the average pixel value for each color component of the respective sensed images. ### Claim 5 (depends on 4) The image processing apparatus according to claim 4, wherein the acquisition of the color temperature of each of the first sensed image and the second sensed image includes: obtaining the average pixel value of an R component and an average pixel value of a B component of the respective sensed images, and acquiring a color temperature that corresponds to (the average pixel value of the B component)/(the average pixel value of the R component). ### Claim 6 (depends on 1) The image processing apparatus according to claim 1, wherein the image processing apparatus is a head-mounted display equipped with the first image sensing device, the second image sensing device, and a display apparatus. ### Claim 7 (depends on 1) The image processing apparatus according to claim 1, wherein the instructions, when executed by the processor, further cause the image processing apparatus to: derive a position and orientation of the first image sensing device, and compose a virtual object, which is generated based on the derived position and orientation of the first image sensing device, with the first sensed image. ### Claim 8 (depends on 7) The image processing apparatus according to claim 7, wherein the derivation of the position and orientation of the first image sensing device is based on the second sensed image. ### Claim 9 (depends on 1) The image processing apparatus according to claim 1, wherein a type of a sensor of the first image sensing device differs from a type of a sensor of the second image sensing device. ### Claim 10 (depends on 9) The image processing apparatus according to claim 9, wherein the sensor of the first image sensing device is of a rolling shutter method, and the sensor of the second image sensing device is of a global shutter method. ### Claim 11 (depends on 1) The image processing apparatus according to claim 1, wherein the adjustment of the color information includes calculating the average color temperature as the common color temperature when a difference between the color temperatures acquired from the first and the second image sensing devices is greater than a predetermined value.