# US 11,029,408 B2 · Distance-imaging system and method of distance imaging > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,029,408 B2 - Document ID: US11029408B2 - Status: Granted - Kind: B2 - Application number: 16/373,902 - Filed: 2019-04-03 - Published: 2020-10-08 - Granted: 2021-06-08 - Earliest claimed: 2019-04-03 - Assignees: Varjo Technologies Oy - Applicants: Varjo Technologies Oy - Inventors: Mikko Ollila; Oiva Arvo Oskari Sahlsten - Web page: https://patentgrep.com/patent/US11029408B2 ## CPC - G01S 17/89: for mapping or imaging - G01B 11/2513: {with several lines being projected in more than one direction, e.g. grids, patterns} - G01S 17/46: Indirect determination of position data - G02B 27/0093: {with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking} - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G06T 7/73: using feature-based methods - H04N 23/71: Circuitry for evaluating the brightness variation - G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES - G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A distance-imaging system including an illuminating unit that projects a spatially non-uniform pattern of light spots onto objects present in real-world environment, first portion of said pattern having higher density of light spots than second portion of said pattern; at least one camera that captures image of reflections of the light spots from surfaces of the objects; and at least one optical element associated with said camera, wherein first optical portion of said optical element has higher magnification factor than second optical portion of said optical element, reflections of said first and second portions of spatially non-uniform pattern of light spots being differently magnified and/or de-magnified by said first and second optical portions, respectively. ## Claims ### Claim 1 A distance-imaging system comprising: an illuminating unit that, in operation, projects a spatially non-uniform pattern of light spots onto objects present in a real-world environment, wherein a first portion of said pattern has a higher density of light spots than a second portion of said pattern; at least one camera that, in operation, captures an image of reflections of the light spots from surfaces of the objects; and at least one optical element associated with the at least one camera, wherein a first optical portion of the at least one optical element has a higher magnification factor than a second optical portion of the at least one optical element, wherein reflections of said first and second portions of the spatially non-uniform pattern of light spots are differently magnified and/or de-magnified in horizontal and vertical directions by said first and second optical portions of the at least one optical element, respectively. ### Claim 2 (depends on 1) The distance-imaging system of claim 1, an angular width of the first portion of the spatially non-uniform pattern with respect to the at least one camera lies in a range of 5 degrees to 60 degrees, and an angular width of the second portion of the spatially non-uniform pattern with respect to the at least one camera lies in a range of 40 degrees to 220 degrees. ### Claim 3 (depends on 1) The distance-imaging system of claim 1, wherein the illuminating unit comprises a plurality of light sources, each of the plurality of light sources, in operation, projecting a spatially uniform pattern of light spots onto the objects present in the real-world environment. ### Claim 4 (depends on 3) The distance-imaging system of claim 3, wherein the plurality of light sources comprise at least a first light source and a second light source, a first pattern of light spots projected by the first light source is denser than a second pattern of light spots projected by the second light source, an angular width associated with the first pattern of light spots is narrower than an angular width associated with the second pattern of light spots. ### Claim 5 (depends on 3) The distance-imaging system of claim 3, further comprising: at least one first actuator associated with at least one of the plurality of light sources; and a processor configured to receive information indicative of a gaze direction of a user, and to control the at least one first actuator to adjust an orientation of the at least one of the plurality of light sources according to the gaze direction of the user. ### Claim 6 (depends on 5) The distance-imaging system of claim 5, further comprising at least one second actuator associated with the at least one optical element, wherein the processor is configured to control the at least one second actuator to adjust a rotational orientation of the at least one optical element according to the gaze direction of the user. ### Claim 7 (depends on 1) The distance-imaging system of claim 1, wherein the illuminating unit comprises: at least one coherent light source that, in operation, emits light pulses; and a diffractive optical element arranged on an optical path of the light pulses. ### Claim 8 (depends on 1) The distance-imaging system of claim 1, wherein the illuminating unit comprises an array of optical emitters, wherein the optical emitters are arranged in a uniform two-dimensional pattern, and wherein the distance-imaging system further comprises a processor configured to receive information indicative of a gaze direction of a user, and to dynamically address the array of optical emitters according to the gaze direction of the user. ### Claim 9 (depends on 8) The distance-imaging system of claim 8, further comprising at least one second actuator associated with the at least one optical element, wherein the processor is configured to control the at least one second actuator to adjust a rotational orientation of the at least one optical element according to the gaze direction of the user. ### Claim 10 (depends on 1) The distance-imaging system of claim 1, wherein the illuminating unit comprises a plurality of optical emitters arranged in a non-uniform two-dimensional pattern. ### Claim 11 (depends on 8) The distance-imaging system of claim 8, wherein the optical emitters comprise vertical-cavity surface-emitting laser diodes. ### Claim 12 A method of distance imaging, via a distance-imaging system comprising an illuminating unit, at least one camera and at least one optical element, the method comprising: projecting, via the illuminating unit, a spatially non-uniform pattern of light spots onto objects present in a real-world environment, wherein a first portion of said pattern has a higher density of light spots than a second portion of said pattern; capturing, via the at least one camera, an image of reflections of the light spots from surfaces of the objects; and differently magnifying and/or de-magnifying reflections of said first and second portions of the spatially non-uniform pattern of light spots in horizontal and vertical directions using first and second optical portions of the at least one optical element, respectively, wherein the first optical portion of the at least one optical element has a higher magnification factor than the second optical portion of the at least one optical element. ### Claim 13 (depends on 12) The method of claim 12, wherein an angular width of the first portion of the spatially non-uniform pattern with respect to the at least one camera lies in a range of 5 degrees to 60 degrees, and an angular width of the second portion of the spatially non-uniform pattern with respect to the at least one camera lies in a range of 40 degrees to 220 degrees. ### Claim 14 (depends on 12) The method of claim 12, wherein the illuminating unit comprises a plurality of light sources, wherein the method further comprises projecting, via each of the plurality of light sources, a spatially uniform pattern of light spots onto the objects present in the real-world environment. ### Claim 15 (depends on 14) The method of claim 14, wherein the plurality of light sources comprise at least a first light source and a second light source, a first pattern of light spots projected by the first light source is denser than a second pattern of light spots projected by the second light source, an angular width associated with the first pattern of light spots is narrower than an angular width associated with the second pattern of light spots. ### Claim 16 (depends on 14) The method of claim 14, further comprising: receiving information indicative of a gaze direction of a user; and adjusting an orientation of at least one of the plurality of light sources according to the gaze direction of the user. ### Claim 17 (depends on 16) The method of claim 16, further comprising adjusting a rotational orientation of the at least one optical element according to the gaze direction of the user. ### Claim 18 (depends on 12) The method of claim 12, wherein the illuminating unit comprises: at least one coherent light source that, in operation, emits light pulses; and a diffractive optical element arranged on an optical path of the light pulses. ### Claim 19 (depends on 12) The method of claim 12, wherein the illuminating unit comprises an array of optical emitters, wherein the optical emitters are arranged in a uniform two-dimensional pattern, and wherein the method further comprises: receiving information indicative of a gaze direction of a user; and dynamically addressing the array of optical emitters according to the gaze direction of the user. ### Claim 20 (depends on 19) The method of claim 19, further comprising adjusting a rotational orientation of the at least one optical element according to the gaze direction of the user.