# US 2025/0085394 A1 · Reality capture with a laser scanner and a camera

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0085394 A1
- Document ID: US20250085394A1
- Status: Published application
- Kind: A1
- Application number: 18/963,355
- Filed: 2024-11-27
- Published: 2025-03-13
- Earliest claimed: 2018-12-21
- Assignees: Leica Geosystems AG
- Applicants: Leica Geosystems AG
- Inventors: Jürgen DOLD; Burkhard BÖCKEM; Roman STEFFEN; Lukas HEINZLE; Ralph Patrick HARTI; Hendrik DESCHOUT; Roland GRAF; Mattheus Henricus Maria MICHELS; Michael DIETSCHI; Adam BAIJRIC; Andrea BONFANTI; Kristian Walker MORIN; Simon MARK; Klaus BEREUTER; Markus RIBI; Michele PORTENTOSO; Matthias WIESER
- Web page: https://patentgrep.com/patent/US20250085394A1

## CPC

- G01S 7/4802: {using analysis of echo signal for target characterisation; Target signature; Target cross-section}
- G01S 7/4812: {transmitted and received beams following a coaxial path}
- G01S 7/003: {Transmission of data between radar, sonar or lidar systems and remote stations}
- G01S 7/4813: {Housing arrangements}
- G01S 7/4817: {relating to scanning}
- G01S 7/51: Display arrangements
- G01S 17/42: Simultaneous measurement of distance and other co-ordinates (indirect measurement G01S17/46)
- G01S 17/58: Velocity or trajectory determination systems; Sense-of-movement determination systems
- G01S 17/86: Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders
- G01S 17/89: for mapping or imaging
- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 7/10: Segmentation; Edge detection (motion-based segmentation G06T7/215)
- G06T 7/521: from laser ranging, e.g. using interferometry; from the projection of structured light
- G06T 7/55: from multiple images
- G06T 7/60: Analysis of geometric attributes
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G08B 13/181: using active radiation detection systems
- G08B 13/19613: {Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion}
- G08B 13/19628: {of wide angled cameras and camera groups, e.g. omni-directional cameras, fish eye, single units having multiple cameras achieving a wide angle view}
- G08B 13/19693: {using multiple video sources viewed on a single or compound screen}
- G01S 7/4808: {Evaluating distance, position or velocity data}
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G08B 13/19697: {Arrangements wherein non-video detectors generate an alarm themselves}
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G08B: SIGNALLING SYSTEMS, e.g. PERSONAL CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS

## Abstract

The present disclosure relates to a reality capture device for generating a digital three-dimensional representation of an environment, particularly for surveying and/or for detecting an object within an infrastructure. One aspect relates to a mobile reality capture device configured to be carried and moved by a mobile carrier, particularly a person or a robot or a vehicle, and to be moved during a measuring process for generating a digital representation of an environment. The mobile reality capture device has a localization unit, particularly comprising an inertial measurement unit (IMU), wherein the localization unit is configured for generating localization data for determining a trajectory of the mobile reality capture device.

## Claims

### Claim 1

A mobile reality capture device configured to be carried and moved by a mobile carrier, particularly a person or a robot or a vehicle, and to be moved during a measuring process for generating a digital representation of an environment, with
a simultaneous localization and mapping (SLAM) unit, particularly comprising an inertial measurement unit (IMU), the SLAM unit being configured to generate SLAM data and, based thereof, a three-dimensional map of the environment and a trajectory of the mobile reality capture device in the three-dimensional map, wherein the three-dimensional map is generated by identifying multiple features in the environment which allow a mutual linkage of the SLAM data, in particular wherein the SLAM unit is configured to determine the trajectory with six degrees of freedom, namely involving position and orientation of the mobile reality capture device, and
a feature tracker, configured to determine, at different positions of the mobile reality capture device along the trajectory, position data for a subset of the multiple features, wherein for each of the different positions of the mobile reality capture device along the trajectory the corresponding position data provide a relative positional relationship between the subset of features relative to the corresponding position of the mobile reality capture device along the trajectory,
wherein the mobile reality capture device is configured to re-initialize the SLAM unit for continuing the generation of the three-dimensional map by recalling at least part of the position data.

### Claim 2 (depends on 1)

The mobile reality capture device according to claim 1, wherein the mobile reality capture device is configured to re-initialize the SLAM unit by recalling:
the position data which has been determined for a last, particularly the most recent, position of the mobile reality capture device along the trajectory, or
a series of position data corresponding to the most recent positions of the mobile reality capture device along the trajectory.

### Claim 3 (depends on 1)

The mobile reality capture device according to claim 1, wherein the mobile reality capture device has an edge computing functionality configured to determine a current location of the mobile reality capture device by means of a comparison of a three-dimensional model based on current SLAM data with a three-dimensional model based on previous SLAM data, wherein the mobile reality capture device is configured to select the position data to re-initialize the SLAM unit based on the determined current location.

### Claim 4 (depends on 3)

The mobile reality capture device according to claim 3, wherein the mobile reality capture device is configured to generate, based on the SLAM data, a three-dimensional model of the environment, particularly a vector file model, and to run a feature recognition algorithm on the three-dimensional model and, based thereof, to recognize semantic and/or geometric features, wherein the mobile reality capture device is configured to:
assign at least part of the recognized semantic and/or geometric features to position data of different positions of the mobile reality capture device along the trajectory, and
to determine a current position along the trajectory based on the recognized semantic and/or geometric features.

### Claim 5 (depends on 1)

The mobile reality capture device according to claim 1, wherein the mobile reality capture device has a guiding unit configured to provide guidance from a current location of the mobile reality capture device towards a desired location, wherein the mobile reality capture device is configured:
to determine a current position within the three-dimensional map or within a three-dimensional model generated by the SLAM data, particularly based on recognized semantic and/or geometric features,
to provide, by means of the guiding unit, guidance from the current position to a target position on the trajectory for which position data were determined, and
to re-initialize the SLAM unit based on the position data, which were determined for the target position.

### Claim 6 (depends on 1)

The mobile reality capture device according to claim 1, wherein the mobile reality capture device is configured to have a built-in position determining unit for generating localization data or to receive localization data from an external position determining unit, wherein the position determining unit is based on at least one of:
triangulation by means of wireless signals, particularly wireless LAN signals,
radio frequency positioning, and
a global navigation satellite system (GNSS),
wherein the mobile reality capture device is configured:
to select the position data to re-initialize the SLAM unit based on the localization data of the position determining unit, or
to provide, by means of the guiding unit, guidance from a current position provided by the localization data to a target position on the trajectory for which position data were determined.

### Claim 7 (depends on 1)

The mobile reality capture device according to claim 1, further comprising:
a laser scanner configured to carry out, during movement of the mobile reality capture device, a scanning movement of a laser measurement beam relative to two rotation axes, and, based thereof, to generate light detection and ranging (LIDAR) data for generating a three-dimensional point cloud, and
a camera unit arranged on a lateral surface of the mobile reality capture device, the lateral surface defining a standing axis of the mobile reality capture device, namely wherein the lateral surface is circumferentially arranged around the standing axis, wherein the camera unit is configured to provide for image data which cover a visual field of more than 180° around the standing axis, particularly 360°.

### Claim 8 (depends on 7)

The mobile reality capture device according to claim 7, characterized in that the mobile reality capture device is configured to generate a colorized three-dimensional point cloud based on the LIDAR data and image data of the camera unit.

### Claim 9 (depends on 7)

The mobile reality capture device according to claim 7, characterized in that the SLAM unit is configured that the SLAM data are based on at least part of the LIDAR data, wherein the mobile reality capture device is configured for carrying out a LIDAR-based localization and mapping algorithm.

### Claim 10 (depends on 7)

The mobile reality capture device according to claim 7, characterized in that the mobile reality capture device comprises a localization camera for being used by the SLAM unit, particularly wherein the localization camera is part of the camera unit, wherein the SLAM unit is configured that the SLAM data are based on image data generated by the localization camera.

### Claim 11 (depends on 10)

The mobile reality capture device according to claim 10, characterized in that the mobile reality capture device comprises multiple localization cameras for being used by the SLAM unit, wherein the multiple localization cameras are configured and arranged that, for a nominal minimum operating range of the SLAM unit, each of the multiple localization cameras has a field of view overlap with at least another one of the multiple localization cameras.

### Claim 12 (depends on 7)

The mobile reality capture device according to claim 7, characterized in that the SLAM unit is configured that the SLAM data is generated by involving at least one of:
data of the IMU (IMU-SLAM), and
image data of the camera unit for visual simultaneous localization and mapping (VSLAM), and
LIDAR data for LIDAR based simultaneous localization and mapping (LIDAR-SLAM).

### Claim 13 (depends on 7)

The mobile reality capture device according to claim 7, further comprising
a base supporting the laser scanner, and
a cover, particularly a cover which is opaque for visible light, mounted on the base such that the cover and the base encase all moving parts of the laser scanner, such that from the outside no moving parts are touchable.

### Claim 14 (depends on 7)

The mobile reality capture device according to claim 7, characterized in that the cover provides a field of view of the laser scanner which is larger than half of a unit sphere around the laser scanner,
wherein the cover has a hemispherical head part which merges in the direction of the base in a cylindrical shell, more particularly wherein the laser scanner is configured that the LIDAR data are generated based on an orientation of the laser measurement beam where it passes through the hemispherical head part and an orientation of the laser measurement beam where it passes through the cylindrical shell.

### Claim 15 (depends on 7)

The mobile reality capture device according to claim 7, characterized in that the laser scanner comprises:
a support, mounted on the base and being rotatable relative to the base, and
a rotating body for deflecting the outgoing laser measurement beam and returning parts of the laser measurement beam, the rotating body being mounted on the support and being rotatable relative to the support,
wherein the generation of the LIDAR data comprises:
a continuous rotation of the support relative to the base and a continuous rotation of the rotating body relative to the support, and
emission of the laser measurement beam via the rotating body, which continuously rotates, and detection of parts of the laser measurement beam returning via the rotating body.

### Claim 16 (depends on 15)

The mobile reality capture device according to claim 15, wherein the laser scanner is configured that the continuous rotation of the rotating body relative to the support is faster than the continuous rotation of the support relative to the base.

### Claim 17 (depends on 16)

The mobile reality capture device according to claim 16, wherein the continuous rotation of the support is at least 0.1 Hz or 1 Hz and the continuous rotation of the rotating body is at least 50 Hz.
