# US 11,441,895 B2 · Control method, depth camera and electronic device > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,441,895 B2 - Document ID: US11441895B2 - Status: Granted - Kind: B2 - Application number: 16/451,737 - Filed: 2019-06-25 - Published: 2019-10-17 - Granted: 2022-09-13 - Earliest claimed: 2018-03-12 - Assignees: Guangdong Oppo Mobile Telecommunications Corp., Ltd. - Applicants: Guangdong Oppo Mobile Telecommunications Corp., Ltd. - Inventors: Yi Wei; Xueyong Zhang - Web page: https://patentgrep.com/patent/US11441895B2 ## CPC - G01B 11/25: by projecting a pattern, e.g. {one or more lines,} moiré fringes on the object (G01B11/255 takes precedence {; image analysis for depth or shape recovery G06T7/50}) - G06T 7/55: from multiple images - G06V 40/161: {Detection; Localisation; Normalisation} - G06V 40/166: {using acquisition arrangements} - G06V 40/171: {Local features and components; Facial parts (eye characteristics G06V40/18); Occluding parts, e.g. glasses; Geometrical relationships} - H04N 13/254: in combination with electromagnetic radiation sources for illuminating objects - H05B 47/115: by determining the presence or movement of objects or living beings - H05B 47/125: by using cameras - G03B 21/2013: {Plural light sources} - G03B 21/2033: {LED or laser light sources} - G06T 2207/10028: Range image; Depth image; 3D point clouds - G06T 2207/30201: Face - H04N 23/51: Housings - G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - H05B: ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL - G03B: APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR (optical parts of such apparatus G02B; photosensitive materials or processes for photographic purposes G03C; apparatus for processing exposed photographic materials G03D) ## Abstract The present disclosure provides a method for controlling a laser projection module, a device for controlling a laser projection module, a depth camera and an electronic device. The laser projection module includes a laser emitter. The laser emitter includes a plurality of point light sources. The plurality of point light sources are grouped to form a plurality of light-emitting arrays, and the plurality of the light-emitting arrays are controlled independently. The method includes: obtaining a current distance between the laser projection module and the user; determining a target number of the light-emitting arrays from the plurality of light-emitting arrays according to the current distance; and activating point light sources in a target number of point light sources of the light-emitting arrays. ## Claims ### Claim 1 A method for controlling a laser projection module, wherein the laser projection module comprises a plurality of point light sources, the plurality of point light sources are grouped to form a plurality of light-emitting arrays, the plurality of light-emitting arrays are controlled independently, and the method comprises: obtaining a current distance between the laser projection module and a user; determining a target number of light-emitting arrays from the plurality of light-emitting arrays according to the current distance; and activating point light sources in the target number of light-emitting arrays, wherein determining the target number of light-emitting arrays and activating the point light sources comprises: in response to determining that the current distance is within a first distance range, activating the point light sources in a first target number of light-emitting arrays from the plurality of light-emitting arrays; in response to determining that the current distance is within a second distance range, activating the point light sources in a second target number of light-emitting arrays from the plurality of light-emitting arrays; and in response to determining that the current distance is within a third distance range, activating the point light sources in a third target number of light-emitting arrays from the plurality of light-emitting arrays; wherein the second distance range is between the first distance range and the third distance range, and the second target number is greater than the first target number and is less than the third target number. ### Claim 2 (depends on 1) The method of claim 1, wherein obtaining the current distance between the laser projection module and the user comprises: obtaining a facial image of the user; processing the facial image to determine a first ratio of a face of the user to the facial image; and determining the current distance based on the first ratio. ### Claim 3 (depends on 2) The method of claim 2, further comprising: calculating a second ratio of a preset feature region of the face in the facial image to the face; and correcting the current distance based on the second ratio. ### Claim 4 (depends on 1) The method of claim 1, wherein obtaining the current distance between the laser projection module and the user comprises: transmitting a detection signal to the user, calculating the current distance according to a detection signal reflected by the user, or activating a predetermined number of light-emitting arrays to detect the current distance between the user and the laser projection module, or obtaining a first image and a second image of the user, and calculating the current distance between the user and the laser projection module according to the first image and the second image. ### Claim 5 (depends on 4) The method of claim 4, further comprising: correcting the current distance by obtaining a facial image of the user, calculating a correction value based on the facial image, and correcting the current distance based on the correction value; wherein the correction value is related to a first ratio of a face of the user to the facial image, a second ratio of a preset feature region of the face in the facial image to the face, an age of the user, and a decision on whether the user wears glasses. ### Claim 6 (depends on 1) The method of claim 1, further comprising: determining a target number of fan-shaped arrays from a plurality of fan-shaped arrays according to the current distance; and activating the point light sources in the target number of fan-shaped arrays, in response to determining that the plurality of light-emitting arrays comprise a plurality of fan-shaped arrays, the plurality of fan-shaped arrays collectively form a circular array, and the plurality of fan-shaped arrays are controlled independently; activating the target number of fan-shaped arrays centrosymmetrically with respect to a center of a laser emitter, in response to determining that the target number is equal to or greater than 2 and the number of the plurality of fan-shaped arrays is a multiple of the target number; or activating the target number of fan-shaped arrays centrosymmetrically with respect to a center of the laser emitter, in response to determining that the target number is equal to or greater than 2 and the number of the plurality of fan-shaped arrays is even. ### Claim 7 (depends on 1) The method of claim 1, further comprising: determining a target number of sub-arrays from a plurality of sub-arrays according to the current distance and activating the point light sources in the target number of sub-arrays, in response to determining that the plurality of light-emitting arrays comprise a plurality of sub-arrays, the plurality of sub-arrays collectively form a circular array, and the plurality of sub-arrays comprises a circular sub-array and at least one annular sub-array; or determining the target number of sub-arrays from the plurality of sub-arrays according to the current distance and activating the point light sources in the target number of sub-arrays, in response to determining that the plurality of light-emitting arrays comprises a plurality of sub-arrays, the plurality of sub-arrays collectively form a rectangle array, and the plurality of sub-arrays comprises a rectangle sub-array and at least one ring-shaped sub-array. ### Claim 8 (depends on 7) The method of claim 7, further comprising: in response to determining that the plurality of sub-arrays comprises a circular sub-array and at least one annular sub-array, the point light sources in the sub-array farther away from a center of the circular sub-array having higher power; or activating the point light sources in the at least one annular sub-array in response to determining that the current distance is within a first distance range, and activating the point light sources in the circular sub-array in response to determining that the current distance is within a second distance range; an upper limit of the first distance range being less than or equal to a lower limit of the second distance range. ### Claim 9 (depends on 1) The method of claim 1, further comprising: determining a target number of rectangle sub-arrays from a plurality of rectangle sub-arrays according to the current distance and activating the point light sources in the target number of rectangle sub-arrays, in response to determining that the plurality of light-emitting arrays comprise a plurality of rectangle sub-arrays, the plurality of rectangle sub-arrays collectively form a rectangle array, and the plurality of rectangle sub-arrays are controlled independently; wherein the plurality of rectangle sub-arrays have a same size to each other or have different sizes from each other. ### Claim 10 A depth camera, comprising an imager and a laser projection module, wherein the laser projection module comprises a plurality of point light sources, the plurality of point light sources are grouped to form a plurality of light-emitting arrays, and the plurality of light-emitting arrays are controlled independently; the depth camera further comprises a processor, the processor is configured to: obtain a current distance between the laser projection module and a user; determine a target number of light-emitting arrays from the plurality of light-emitting arrays according to the current distance; and activate the point light sources in the target number of light-emitting arrays; wherein in response to determining that the current distance is within a first distance range, activate the point light sources in a first target number of light-emitting arrays from the plurality of light-emitting arrays; wherein in response to determining that the current distance is within a second distance range, activate the point light sources in a second target number of light-emitting arrays from the plurality of light-emitting arrays; wherein in response to determining that the current distance is within a third distance range, activate the point light sources in a third target number of light-emitting arrays from the plurality of light-emitting arrays; and wherein the second distance range is between the first distance range and the third distance range, and the second target number is greater than the first target number and is less than the third target number. ### Claim 11 (depends on 10) The depth camera of claim 10, wherein the processor is further configured to: obtain a facial image of the user; process the facial image to determine a first ratio of a face of the user to the facial image; and determine the current distance based on the first ratio. ### Claim 12 (depends on 11) The depth camera of claim 11, wherein the processor is further configured to: calculate a second ratio of a preset feature region of the face in the facial image to the face; and correct the current distance based on the second ratio. ### Claim 13 (depends on 10) The depth camera of claim 10, wherein, the laser projection module is configured to transmit a detection signal to the user and the processor is further configured to calculate the current distance according to a detection signal reflected by the user; or the processor is configured to activate a predetermined number of light-emitting arrays to detect the current distance between the user and the laser projection module; or the processor is configured to obtain a first image and a second image of the user and to calculate the current distance between the user and the laser projection module according to the first image and the second image. ### Claim 14 (depends on 13) The depth camera of claim 13, wherein the processor is further configured to correct the current distance by: obtain a facial image of the user, calculating a correction value based on the facial image, and correcting the current distance based on the correction value, wherein the correction value is related to a first ratio of a face of the user to the facial image, a second ratio of a preset feature region of the face in the facial image to the face, an age of the user, and a decision on whether the user wears glasses. ### Claim 15 (depends on 10) The depth camera of claim 10, wherein the processor is configured to: determine a target number of fan-shaped arrays from a plurality of fan-shaped arrays according to the current distance and activate the point light sources in the target number of fan-shaped arrays, in response to determining that the plurality of light-emitting arrays comprise a plurality of fan-shaped arrays, the plurality of fan-shaped arrays collectively form a circular array, and the plurality of fan-shaped arrays are controlled independently; and activate the target number of fan-shaped arrays centrosymmetrically with respect to a center of a laser emitter, in response to determining that the target number is equal to or greater than 2 and the number of the plurality of fan-shaped arrays is a multiple of the target number; or activate the target number of fan-shaped arrays centrosymmetrically with respect to a center of the laser emitter, in response to determining that the target number is equal to or greater than 2 and the number of the plurality of fan-shaped arrays is even. ### Claim 16 (depends on 10) The depth camera of claim 10, wherein the processor is further configured to: determine a target number of sub-arrays from a plurality of sub-arrays according to the current distance and activate the point light sources in the target number of sub-arrays, in response to determining that the plurality of light-emitting arrays comprise a plurality of sub-arrays, the plurality of sub-arrays collectively form a circular array, and the plurality of sub-arrays comprises a circular sub-array and at least one annular sub-array; or determine the target number of sub-arrays from the plurality of sub-arrays according to the current distance and activate the point light sources in the target number of sub-arrays, in response to determining that the plurality of light-emitting arrays comprises a plurality of sub-arrays, the plurality of sub-arrays collectively form a rectangle array, and the plurality of sub-arrays comprises a rectangle sub-array and at least one ring-shaped sub-array. ### Claim 17 (depends on 16) The depth camera of claim 16, wherein, in response to determining that the plurality of sub-arrays comprises a circular sub-array and at least one annular sub-array, the point light sources in the sub-array farther away from a center of the circular sub-array have higher power; or the processor is further configured to activate the point light sources in the at least one annular sub-array, in response to determining that the current distance is within a first distance range; and activate the point light sources in the circular sub-array, in response to determining that the current distance is within a second distance rang, an upper limit of the first distance range being less than or equal to a lower limit of the second distance range. ### Claim 18 (depends on 10) The depth camera of claim 10, wherein the processor is further configured to: determine a target number of rectangle sub-arrays from a plurality of rectangle sub-arrays according to the current distance and activate the point light sources in the target number of rectangle sub-arrays, in response to determining that the plurality of light-emitting arrays comprise a plurality of rectangle sub-arrays, the plurality of rectangle sub-arrays collectively form a rectangle array, and the plurality of rectangle sub-arrays are controlled independently; wherein the plurality of rectangle sub-arrays have a same size to each other or have different sizes from each other. ### Claim 19 An electronic device, comprising: a housing; and a depth camera, disposed in the housing and exposed from the housing to obtain a depth image; wherein the depth camera comprises an imager and a laser projection module, the laser projection module comprises a plurality of point light sources, the plurality of point light sources are grouped to form a plurality of light-emitting arrays, and the plurality of light-emitting arrays are controlled independently; the depth camera further comprises a processor, the processor is configured to: obtain a current distance between the laser projection module and a user; determine a target number of light-emitting arrays from the plurality of light-emitting arrays according to the current distance; and activate the point light sources in the target number of light-emitting arrays; wherein determining the target number of light-emitting arrays and activating the point light sources comprises: in response to determining that the current distance is within a first distance range, activating the point light sources in a first target number of light-emitting arrays from the plurality of light-emitting arrays; in response to determining that the current distance is within a second distance range, activating the point light sources in a second target number of light-emitting arrays from the plurality of light-emitting arrays; and in response to determining that the current distance is within a third distance range, activating the point light sources in a third target number of light-emitting arrays from the plurality of light-emitting arrays; wherein the second distance range is between the first distance range and the third distance range; and the second target number is greater than the first target number and is less than the third target number.