# US 10,313,654 B1 · Image processing method, electronic device, and non-transitory computer readable storage medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,313,654 B1 - Document ID: US10313654B1 - Status: Granted - Kind: B1 - Application number: 15/925,738 - Filed: 2018-03-19 - Granted: 2019-06-04 - Earliest claimed: 2018-03-19 - Assignees: HTC Corporation - Applicants: HTC Corporation - Inventors: Wen-Hsiang Yu - Web page: https://patentgrep.com/patent/US10313654B1 ## CPC - H04N 5/2226: {Determination of depth image, e.g. for foreground/background separation (determining depth by image analysis in general G06T7/50; segmentation by image analysis in general G06T7/10)} - H04N 13/156: Mixing image signals - G06T 7/11: Region-based segmentation - G06T 7/593: from stereo images - H04N 7/181: {for receiving images from a plurality of remote sources} - H04N 13/128: Adjusting depth or disparity - H04N 13/158: {Switching image signals} - H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) - H04N 23/45: for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images - H04N 23/6812: {based on additional sensors, e.g. acceleration sensors} - H04N 23/687: {by shifting the lens or sensor position} - G06T 2207/10021: Stereoscopic video; Stereoscopic image sequence - H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract An image processing method includes: obtaining, by a first position sensor, a first lens position of a first camera; obtaining, by a second position sensor, a second lens position of a second camera; calculating, by a processing circuit, a relative optical geometry of the first camera and the second camera according to the first lens position and the second lens position; and performing, by the processing circuit, an image switch, an image fusion, or a depth calculation based on the relative optical geometry on the condition that an optical image stabilization is enabled to at least one of the first camera and the second camera. ## Claims ### Claim 1 An image processing method comprising: obtaining, by a first position sensor, a first lens position of a first camera; obtaining, by a second position sensor, a second lens position of a second camera; calculating, by a processing circuit, a relative optical geometry of the first camera and the second camera according to the first lens position and the second lens position; and performing, by the processing circuit, an image switch, an image fusion, or a depth calculation based on the relative optical geometry on the condition that an optical image stabilization is enabled to at least one of the first camera and the second camera. ### Claim 2 (depends on 1) The image processing method of claim 1, further comprising: obtaining, by an inertial measurement unit sensor, an IMU signal indicating a movement of the first camera and of the second camera; and calculating, by the processing circuit, the relative optical geometry of the first camera and the second camera further according to the IMU signal. ### Claim 3 (depends on 2) The image processing method of claim 2, further comprising: enabling the optical image stabilization to at least one of the first camera and the second camera according to the IMU signal. ### Claim 4 (depends on 1) The image processing method of claim 1, further comprising: updating, by the processing circuit, one or more parameters for image and corresponding points matching according to the relative optical geometry of the first camera and the second camera; and performing, by the processing circuit, the image switch, the image fusion, or the depth calculation based on the updated one or more parameters. ### Claim 5 (depends on 4) The image processing method of claim 4, further comprising: recovering, by the processing circuit, the previous one or more parameters for image and corresponding points matching based on a result of the image switch, the image fusion, or the depth calculation. ### Claim 6 (depends on 1) The image processing method of claim 1, further comprising: updating, by the processing circuit, a center coordinate of a region of interest for image and corresponding points matching according to the relative optical geometry of the first camera and the second camera; and performing, by the processing circuit, the image switch, the image fusion, or the depth calculation based on the updated center coordinate of the region of interest. ### Claim 7 (depends on 1) The image processing method of claim 1, further comprising: moving, by an actuator connected to the first camera or to the second camera, a lens of the first camera or of the second camera to enable the optical image stabilization. ### Claim 8 An electronic device, comprising: a processing circuit; a first camera and a second camera electrically connected to the processing circuit respectively; a first position sensor and a second position sensor electrically connected to the processing circuit respectively; a memory electrically connected to the processing circuit; and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processing circuit, the one or more programs comprising instructions for: controlling the first position sensor to obtain a first lens position of the first camera; controlling the second position sensor to obtain a second lens position of the second camera; calculating a relative optical geometry of the first camera and the second camera according to the first lens position and the second lens position; and performing an image switch, an image fusion, or a depth calculation based on the relative optical geometry on the condition that an optical image stabilization is enabled to at least one of the first camera and the second camera. ### Claim 9 (depends on 8) The electronic device of claim 8, further comprising an inertial measurement unit sensor electrically connected to the processing circuit, wherein the one or more programs further comprise instructions for: controlling the inertial measurement unit sensor to obtain an IMU signal indicating a movement of the first camera and of the second camera; and calculating the relative optical geometry of the first camera and the second camera further according to the IMU signal. ### Claim 10 (depends on 9) The electronic device of claim 9, wherein the one or more programs further comprise instructions for: enabling the optical image stabilization to at least one of the first camera and the second camera according to the IMU signal. ### Claim 11 (depends on 8) The electronic device of claim 8, wherein the one or more programs further comprise instructions for: updating one or more parameters for image and corresponding points matching according to the relative optical geometry of the first camera and the second camera; and performing the image switch, the image fusion, or the depth calculation based on the updated one or more parameters. ### Claim 12 (depends on 11) The electronic device of claim 11, wherein the one or more programs further comprise instructions for: recovering the previous one or more parameters for image and corresponding points matching based on a result of the image switch, the image fusion, or the depth calculation. ### Claim 13 (depends on 8) The electronic device of claim 8, wherein the one or more programs further comprise instructions for: updating a center coordinate of a region of interest for image and corresponding points matching according to the relative optical geometry of the first camera and the second camera; and performing the image switch, the image fusion, or the depth calculation based on the updated center coordinate of the region of interest. ### Claim 14 (depends on 8) The electronic device of claim 8, further comprising: an actuator connected to the first camera or to the second camera; and wherein the one or more programs further comprise instructions for: controlling the actuator to move a lens of the first camera or of the second camera to enable the optical image stabilization. ### Claim 15 A non-transitory computer readable storage medium storing one or more programs, comprising instructions, which when executed, causes a processing circuit to perform operations comprising: controlling a first position sensor to obtain a first lens position of a first camera; controlling a second position sensor to obtain a second lens position of a second camera; calculating a relative optical geometry of the first camera and the second camera according to the first lens position and the second lens position; and performing an image switch, an image fusion, or a depth calculation based on the relative optical geometry on the condition that an optical image stabilization is enabled to at least one of the first camera and the second camera. ### Claim 16 (depends on 15) The non-transitory computer readable storage medium of claim 15, further comprising instructions, which when executed, causes the processing circuit to further perform operations comprising: controlling an inertial measurement unit sensor to obtain an IMU signal indicating a movement of the first camera and of the second camera; and calculating the relative optical geometry of the first camera and the second camera further according to the IMU signal. ### Claim 17 (depends on 16) The non-transitory computer readable storage medium of claim 16, further comprising instructions, which when executed, causes the processing circuit to further perform operations comprising: enabling the optical image stabilization to at least one of the first camera and the second camera according to the IMU signal. ### Claim 18 (depends on 15) The non-transitory computer readable storage medium of claim 15, further comprising instructions, which when executed, causes the processing circuit to further perform operations comprising: updating one or more parameters for image and corresponding points matching according to the relative optical geometry of the first camera and the second camera; and performing the image switch, the image fusion, or the depth calculation based on the updated one or more parameters. ### Claim 19 (depends on 18) The non-transitory computer readable storage medium of claim 18, further comprising instructions, which when executed, causes the processing circuit to further perform operations comprising: recovering the previous one or more parameters for image and corresponding points matching based on a result of the image switch, the image fusion, or the depth calculation. ### Claim 20 (depends on 15) The non-transitory computer readable storage medium of claim 15, further comprising instructions, which when executed, causes the processing circuit to further perform operations comprising: updating a center coordinate of a region of interest for image and corresponding points matching according to the relative optical geometry of the first camera and the second camera; and performing the image switch, the image fusion, or the depth calculation based on the updated center coordinate of the region of interest.