# US 2019/0174118 A1 · Depth imaging device and driving method thereof > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0174118 A1 - Document ID: US20190174118A1 - Status: Published application - Kind: A1 - Application number: 15/866,446 - Filed: 2018-01-09 - Published: 2019-06-06 - Earliest claimed: 2017-12-05 - Assignees: Lite-On Electronics (Guangzhou) Limited; Lite-On Technology Corporation - Applicants: Lite-On Electronics (Guangzhou) Limited; Lite-On Technology Corporation - Inventors: Shou-Te Wei; Hsing-Hung Chen - Web page: https://patentgrep.com/patent/US20190174118A1 ## CPC - H04N 13/239: using two two-dimensional [2D] image sensors having a relative position equal to or related to the interocular distance (H04N13/243 takes precedence) - G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light - G06T 7/593: from stereo images - H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects - H04N 13/271: wherein the generated image signals comprise depth maps or disparity maps - H04N 23/60: Control of cameras or camera modules - G06T 2207/10028: Range image; Depth image; 3D point clouds - H04N 2013/0081: {Depth or disparity estimation from stereoscopic image signals} - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ## Abstract A depth imaging device is provided. A first camera and a second camera form a first depth imaging system. A projection element and a second camera form a second depth imaging system. The control unit is configured to instruct one of the first and second depth imaging systems to acquire a depth map and a confidence map, and determine whether each of confidence values in the confidence map is less than a confidence threshold value. If each of the confidence values is less than the confidence threshold value, then the control unit turns on the other of the first and second depth imaging systems. If at least one of the confidence values is not less the confidence threshold value, then the control unit determines whether a closest distance in the depth map falls within a predetermined range or not. A driving method of a depth imaging device is also provided. ## Claims ### Claim 1 A depth imaging device, comprising: a first camera; a second camera, wherein the first camera and the second camera form a first depth imaging system; a projection element, wherein the projection element and the second camera form a second depth imaging system, wherein a distance between the projection element and the second camera is not equal to a distance between the first camera and the second camera; and a control unit, electrically connected to the first camera, the second camera and the projection element, wherein the control unit is configured to instruct one of the first depth imaging system and the second depth imaging system to acquire a depth map and a confidence map corresponding to the depth map, and determine whether each of confidence values in the confidence map is smaller than a confidence threshold value, if each of the confidence values is smaller than the confidence threshold value, the control unit turns on the other one of the first depth imaging system and the second depth imaging system, if at least one of the confidence values is not smaller than the confidence threshold value, the control unit determines whether a closest distance in the depth map falls within a predetermined range, if the closest distance falls within the predetermined range, the control unit does not turn on the other one of the first depth imaging system and the second depth imaging system, and if the closest distance is not within the predetermined range, the control unit turns on the other one of the first depth imaging system and the second depth imaging system. ### Claim 2 (depends on 1) The depth imaging device as claimed in claim 1, wherein the control unit is configured to instruct the first depth imaging system to acquire the depth map and the confidence map corresponding to the depth map, and determine whether each of the confidence values in the confidence map is smaller than the confidence threshold value, if each of the confidence values is smaller than the confidence threshold value, the control unit turns on the second depth imaging system, and if at least one of the confidence values is not smaller than the confidence threshold value, the control unit determines whether the closest distance in the depth map falls within the predetermined range, wherein the predetermined range is that the closest distance is greater than or equal to a distance threshold value, if the closest distance falls within the predetermined range, the control unit does not turn on the second depth imaging system, and if the closest distance is not within the predetermined range, the control unit turns on the second depth imaging system and the projection element. ### Claim 3 (depends on 2) The depth imaging device as claimed in claim 2, wherein the distance between the projection element and the second camera is smaller than the distance between the first camera and the second camera. ### Claim 4 (depends on 1) The depth imaging device as claimed in claim 1, wherein the control unit is configured to instruct the second depth imaging system to acquire the depth map and the confidence map corresponding to the depth map, and determine whether each of the confidence values in the confidence map is smaller than the confidence threshold value, if each of the confidence values is smaller than the confidence threshold value, the control unit turns off the projection element and turns on the first depth imaging system, and if at least one of the confidence values is not smaller than the confidence threshold value, the control unit determines whether the closest distance in the depth map falls within the predetermined range, wherein the predetermined range is that the closest distance is smaller than or equal to a distance threshold value, if the closest distance falls within the predetermined range, the control unit does not turn on the first depth imaging system, and if the closest distance is not within the predetermined range, the control unit turns off the projection element and turns on the first depth imaging system. ### Claim 5 (depends on 4) The depth imaging device as claimed in claim 4, wherein the distance between the projection element and the second camera is smaller than the distance between the first camera and the second camera. ### Claim 6 (depends on 1) The depth imaging device as claimed in claim 1, wherein the first camera, the projection element and the second camera are arranged on a straight line. ### Claim 7 (depends on 1) The depth imaging device as claimed in claim 1, wherein the projection element is configured to project a structured light. ### Claim 8 A driving method for a depth imaging device, comprising: (a) instructing one of a first depth imaging system and a second depth imaging system to acquire a depth map and a confidence map corresponding to the depth map, wherein a first camera and a second camera form the first depth imaging system, and a projection element and the second camera form the second depth imaging system, and a distance between the projection element and the second camera is not equal to a distance between the first camera and the second camera; and (b) determining whether each of confidence values in the confidence map is smaller than a confidence threshold value, if each of the confidence values is smaller than the confidence threshold value, turning on the other one of the first depth imaging system and the second depth imaging system, and if at least one of the confidence values is not smaller than the confidence threshold value, determining whether a closest distance in the depth map falls within a predetermined range, if the closest distance falls within the predetermined range, not turning on the other one of the first depth imaging system and the second depth imaging system, and if the closest distance is not within the predetermined range, turning on the other one of the first depth imaging system and the second depth imaging system. ### Claim 9 (depends on 8) The driving method for the depth imaging device as claimed in claim 8, wherein the step (a) comprises instructing the first depth imaging system to acquire the depth map and the confidence map corresponding to the depth map, and the step (b) comprises determining whether each of the confidence values in the confidence map is smaller than the confidence threshold value, if each of the confidence values is smaller than the confidence threshold value, turning on the second depth imaging system, if at least one of the confidence values is not smaller than the confidence threshold value, determining whether the closest distance in the depth map falls within the predetermined range, wherein the predetermined range is that the closest distance is greater than or equal to a distance threshold value, if the closest distance falls within the predetermined range, not turning on the second depth imaging system, and if the closest distance is not within the predetermined range, turning on the second depth imaging system and the projection element. ### Claim 10 (depends on 9) The driving method for the depth imaging device as claimed in claim 9, wherein the distance between the projection element and the second camera is smaller than the distance between the first camera and the second camera. ### Claim 11 (depends on 8) The driving method for the depth imaging device as claimed in claim 8, wherein the step (a) comprises instructing the second depth imaging system to acquire the depth map and the confidence map corresponding to the depth map, and the step (b) comprises determining whether each of the confidence values in the confidence map is smaller than the confidence threshold value, if each of the confidence values is smaller than the confidence threshold value, turning off the projection element and turning on the first depth imaging system, if at least one of the confidence values is not smaller than the confidence threshold value, determining whether the closest distance in the depth map falls within the predetermined range, wherein the predetermined range is that the closest distance is smaller than or equal to a distance threshold value, if the closest distance falls within the predetermined range, not turning on the first depth imaging system, and if the closest distance is not within the predetermined range, turning off the projection element and turning on the first depth imaging system. ### Claim 12 (depends on 11) The driving method for the depth imaging device as claimed in claim 11, wherein the distance between the projection element and the second camera is smaller than the distance between the first camera and the second camera. ### Claim 13 (depends on 8) The driving method for the depth imaging device as claimed in claim 8, wherein the first camera, the projection element and the second camera are arranged on a straight line. ### Claim 14 (depends on 8) The driving method for the depth imaging device as claimed in claim 8, wherein when the second depth imaging system is turned on, the projection element is instructed to project a structured light.