# US 2013/0278758 A1 · Method and system for determining position and orientation of a measuring instrument

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0278758 A1
- Document ID: US20130278758A1
- Status: Published application
- Kind: A1
- Application number: 13/978,187
- Filed: 2011-01-10
- Published: 2013-10-24
- Earliest claimed: 2011-01-10
- Assignees: Trimble Inc.
- Inventors: Johan Von Matern
- Web page: https://patentgrep.com/patent/US20130278758A1

## CPC

- G01C 15/002: {Active optical surveying means (optical plumbing G01C15/105)}
- G01B 11/14: for measuring distance or clearance between spaced objects or spaced apertures (G01B11/26 takes precedence; rangefinders G01C3/00)
- G01S 5/163: {Determination of attitude (using inertial means G01C9/00; control of attitude G05D1/49)}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 2200/21: involving computational photography
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01B: MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A method for determining position and orientation of a first measuring instrument is disclosed. A second MI and at least one reflective target including a retroreflector unit are arranged in the vicinity of the first MI. At least one imaging module is arranged in the first MI for determining orientation thereof. The at least one imaging module in the first MI can be used in a similar manner as a tracker unit of an optical total station, by way of detecting optical radiation emitted from the second MI and reflected by the at least one TGT.

## Claims

### Claim 1

A method for determining position and orientation of a first measuring instrument, MI, including a retroreflector unit, at least one first optical radiation source configured to emit optical radiation when activated, said method comprising selectively activating and deactivating the at least one first optical radiation source, and at least one imaging module, using a second MI, including at least one second optical radiation source configured to emit optical radiation when activated, and at least one target, TGT, including at least one identifying device enabling the TGT to be identified in an image capturing said TGT, the method comprising:
measuring angle and distance to the first MI and the at least one TGT, respectively, in relation to the second MI;
causing the at least one imaging module to capture images, including alternating activation and deactivation of the at least one second optical radiation source;
producing an image representation of each captured image;
creating differential images using said image representations;
extracting information regarding objects being present in the differential images;
using said extracted information, distinguishing the second MI and the at least one TGT, respectively, from any other objects present in the images;
on a condition that the second MI and the at least one TGT can be distinguished from any other objects present in the images:
on basis of said extracted information, processing any of said image representations to determine angular information of the second MI and/or the at least one TGT with respect to at least one axis, respectively;
on basis of angle and distance to the second MI and/or the at least one TGT, respectively, in relation to the first MI, and the angular information, estimating orientation of the first MI.

### Claim 2 (depends on 1)

A method according to claim 1, wherein the causing comprises causing the at least one imaging module to capture images, including alternating activation and deactivation of the at least one first optical radiation source and of the at least one second optical radiation source.

### Claim 3 (depends on 1)

A method according to claim 1, wherein said at least one identifying device of said TGT is retroreflector unit, said TGT being a reflective target.

### Claim 4 (depends on 1)

A method according to claim 1, wherein said at least one identifying device comprises at least one optical radiation source configured to continuously emit optical radiation or to emit optical radiation when activated.

### Claim 5 (depends on 1)

A method according to claim 1, wherein said at least one identifying device comprises at least one geometrical symbol and/or pattern.

### Claim 6 (depends on 1)

A method according to claim 1, wherein the causing of the at least one imaging module to capture images comprises:
causing the at least one imaging module to capture at least one first image when the at least one second optical radiation source is activated and the at least one first optical radiation source is deactivated;
causing the at least one imaging module to capture at least one second image when the at least one second optical radiation source is deactivated and the at least one first optical radiation source is activated or when the at least one second optical radiation source is activated and the at least one first optical radiation source is activated;
causing the at least one imaging module to capture at least one third image when the at least one second optical radiation source and the at least one first optical radiation source are deactivated.

### Claim 7 (depends on 1)

A method according to claim 1, wherein the causing of the at least one imaging module to capture images comprises:
causing the at least one imaging module to capture at least one first image when the at least one second optical radiation source is activated and the at least one first optical radiation source is deactivated;
causing the at least one imaging module to capture at least one second image when the at least one second optical radiation source is deactivated and the at least one first optical radiation source is activated.

### Claim 8 (depends on 6)

A method according to claim 6, wherein creating differential images using said image representations comprises:
creating at least one first differential image between the at least one first and the at least one third image representation;
creating at least one second differential image between the at least one second and the at least one third image representation.

### Claim 9 (depends on 8)

A method according to claim 8, wherein extracting information regarding objects being present in the differential images comprises:
extracting information regarding objects being present in the at least one first differential image and the at least one second differential image, respectively.

### Claim 10 (depends on 7)

A method according to claim 7, wherein creating differential images using said image representations comprises:
creating at least one first differential image between the at least one first and the at least one second image representation.

### Claim 11 (depends on 10)

A method according to claim 10, wherein extracting information regarding objects being present in the differential images comprises:
extracting information regarding objects being present in the at least one first differential image.

### Claim 12 (depends on 1)

A method according to claim 1, wherein the processing of any of said image representations to determine angular information of the second MI and the at least one TGT with respect to at least one axis comprises processing any of said image representations to estimate at least one angle between the second MI and the at least one TGT with respect to the at least one axis, wherein the angular information comprises the estimated at least one angle.

### Claim 13 (depends on 12)

A method according to claim 12, wherein the processing of any of said image representations to estimate at least one angle between the second MI and the at least one TGT with respect to the at least one axis comprises determining distance between the second MI and the at least one TGT, distance between the second MI and the at least one axis and/or distance between the at least one TGT and the at least one axis.

### Claim 14 (depends on 13)

A method according to claim 13, wherein said determination of distances comprises determining a number of pixels in any of the images between the second MI and the at least one TGT, between the second MI and the at least one axis and/or between the at least one TGT and the at least one axis, respectively, wherein a dimension of a pixel in the images corresponds to a predetermined distance.

### Claim 15 (depends on 1)

A method according to claim 1, further comprising:
on basis of measured angle and distance relatively to the first MI and the at least one TGT, respectively, determining the position of the first MI and the position of the at least one TGT;
on basis of the position of the first MI and the position of the at least one TGT, determining distance between the first MI and the at least one TGT;
deriving distance between the first MI and the at least one TGT from said extracted information;
comparing distance between the first MI and the at least one TGT with distance between the first MI and the at least one TGT derived from said extracted information; and
on basis of the comparison, assessing the accuracy of the distinguishing of the first MI and the at least one TGT, respectively, from any other objects present in the images.

### Claim 16 (depends on 15)

A method according to claim 15, further comprising:
determining compliance of the accuracy of said assessment relatively to a predetermined accuracy criteria.

### Claim 17 (depends on 3)

A method according to claim 3, wherein measuring angle and distance to the first MI and the at least one TGT, respectively, in relation to the second MI comprises transmitting optical radiation from the at least one second optical radiation source and receiving optical radiation reflected by the retroreflector unit of the first MI and the retroreflector unit of the at least one TGT, respectively.

### Claim 18 (depends on 17)

A method according to claim 17, wherein measuring angle and distance to the first MI and the at least one TGT, respectively, relatively to the second MI is performed by way of measuring time-of-flight of optical radiation from the at least one second optical radiation source to the first MI and the at least one TGT, respectively, and/or by measuring phase difference of modulated continuous-wave optical radiation from the at least one second optical radiation source subsequent to the modulated continuous-wave optical radiation having been reflected by the retroreflector unit of the first MI and the retroreflector unit of the at least one TGT, respectively.

### Claim 19

A system comprising a first measuring instrument, MI including a retroreflector unit; a second MI; and at least one target, TGT, said system being arranged for determining position and orientation of the first MI, wherein
the at least one TGT includes at least one identification device configured to enable said TGT to be identified in an image capturing said TGT;
the second MI comprising at least one second optical radiation source, configured to emit optical radiation when activated, and a position calculating circuit, comprising an angle measuring system and a distance measuring system (126), adapted to measure angle and distance to the first MI and the at least one TGT, respectively;
the first MI further comprising:
at least one first optical radiation source configured to emit optical radiation when activated and a control module adapted to selectively activate and deactivate the at least one first optical radiation source;
a communication module adapted to, on instruction from the control module, communicate control signals to the second MI for activating or deactivating the at least one second optical radiation source, the communication module being further adapted to receive signals from the second MI indicating distances and angles determined by the second MI; and
at least one imaging module adapted to, on instruction from the control module, capture an image, wherein the control module is adapted to cause the at least one imaging module to capture images including alternating activation and deactivation of the at least one second optical radiation source, and produce an image representation of each captured image;
a processing module adapted to:
create differential images using said image representations;
extract information regarding objects being present in the differential images;
distinguish the second MI and the at least one TGT, respectively, from any other objects present in the images using said extracted information;
wherein the processing module is further adapted to, on a condition that the second MI and the at least one TGT can be distinguished from any other objects present in the images:
on basis of said extracted information, process any of the image representations to determine angular information of the second MI and/or the at least one TGT with respect to at least one axis, respectively; and
on basis of angle and distance to the second MI and the at least one TGT, respectively, and the angular information, estimate orientation of the first MI.

### Claim 20 (depends on 19)

A system according to claim 19, wherein the control module of said first MI is adapted to cause the at least one imaging module to capture images including alternating activation and deactivation of the at least one first optical radiation source and the at least one second optical radiation source.

### Claim 21 (depends on 19)

A system according to claim 19, wherein said at least one identifying device is a retroreflector unit, said TGT being a reflective target.

### Claim 22 (depends on 19)

A system according to claim 19, wherein said least one identifying device comprises at least one optical radiation source configured to continuously emit optical radiation or to emit optical radiation when activated.

### Claim 23 (depends on 19)

A system according to claim 19, wherein said least one identifying device comprises at least one geometrical symbol and/or pattern.

### Claim 24 (depends on 19)

A system according to claim 19, wherein the control module is adapted to cause the at least one imaging module to capture images by causing the at least one imaging module to capture at least one first image when the at least one second optical radiation source is activated and the at least one first optical radiation source is deactivated, cause the at least one imaging module to capture at least one second image when the at least one second optical radiation source is deactivated and the at least one first optical radiation source is activated or cause the at least one imaging module to capture at least one second image when the at least one second optical radiation source is activated and the at least one first optical radiation source is activated, and to cause the at least one imaging module to capture at least one third image when the at least one second optical radiation source and the at least one first optical radiation source are deactivated.

### Claim 25 (depends on 19)

A system according to claim 19, wherein the control module is adapted to cause the at least one imaging module to capture images by causing the at least one imaging module to capture at least one first image when the at least one second optical radiation source is activated and the at least one first optical radiation source is deactivated, and causing the at least one imaging module to capture at least one second image when the at least one second optical radiation source is deactivated and the at least one first optical radiation source is activated.

### Claim 26 (depends on 24)

A system according to claim 24, wherein the processing module is adapted to create differential images using said image representations by creating at least one first differential image between the at least one first and the at least one third image representation and creating at least one second differential image between the at least one second and the at least one third image representation.

### Claim 27 (depends on 26)

A system according to claim 26, wherein the processing module is adapted to extract information regarding objects being present in the differential images by extracting information regarding objects being present in the at least one first differential image and the at least one second differential image, respectively.

### Claim 28 (depends on 25)

A system according to claim 25, wherein the processing module is adapted to create differential images using said image representations by creating at least one first differential image between the at least one first and the at least one second image representation.

### Claim 29 (depends on 28)

A system according to claim 28, wherein the processing module is adapted to extract information regarding objects being present in the differential images by extracting information regarding objects being present in the at least one first differential image.

### Claim 30 (depends on 19)

A system according to claim 19, wherein the processing unit is further adapted to process any of said image representations to determine angular information of the second MI and the at least one TGT with respect to at least one axis by estimating at least one angle between the second MI and the at least one TGT with respect to the at least one axis, wherein the angular information comprises the estimated at least one angle.

### Claim 31 (depends on 30)

A system according to claim 30, wherein the processing unit is further adapted to estimate the at least one angle by determining distance between the second MI and the at least one target, distance between the second MI and the at least one axis and/or distance between the at least one target and the at least one axis.

### Claim 32 (depends on 31)

A system according to claim 31, wherein the processing unit is further adapted to determine distance between the second MI and the at least one target, distance between the second MI and the at least one axis and/or distance between the at least one target and the at least one axis by determining a number of pixels in any of the images between the second MI and the at least one target, between the second MI and the at least one axis and/or between the at least one target and the at least one axis, respectively, wherein a dimension of a pixel in the images corresponds to a predetermined distance.

### Claim 33 (depends on 19)

A system according to claim 19, wherein the processing unit is further adapted to:
on basis of measured angle and distance relatively to the first MI and the at least one TGT, respectively, determine the position of the first MI and the position of the at least one TGT;
on basis of the position of the first MI and the position of the at least one TGT, determine distance between the first MI and the at least one TGT;
derive distance between the first MI and the at least one TGT from said extracted information;
compare distance between the first MI and the at least one TGT with distance between the first MI and the at least one TGT derived from said extracted information; and
on basis of the comparison, assess the accuracy of the distinguishing of the first MI and the at least one TGT, respectively, from any other objects present in the images.

### Claim 34 (depends on 21)

A system according to claim 21, wherein the position calculating circuit is adapted to transmit optical radiation from the at least one second optical radiation source and receive reflected optical radiation and measure angle and distance to the first MI and the at least one TGT, respectively, by way of measuring time-of-flight of optical radiation from the at least one second optical radiation source to the first MI and the at least one TGT, respectively, and/or by way of measuring phase difference of modulated continuous-wave optical radiation from the at least one second optical radiation source subsequent to the modulated continuous-wave optical radiation having been reflected by the retroreflector unit of the first MI and the retroreflector unit of the at least one TGT, respectively.

### Claim 35 (depends on 19)

A system according to claim 19, wherein the second MI further comprises a tracker and a servo system configured to monitor the position of the first MI, and the control module is adapted to consecutively capture sets of images including alternating activation and deactivation of the at least one first optical radiation source and the at least one second optical radiation source, and estimate orientation of the first MI on basis of each of the captured sets of images.

### Claim 36 (depends on 35)

A system according to claim 35, wherein the communication module is further adapted to, on instruction from the control module, communicate control signals to the second MI configured to temporally synchronize the monitoring of the position of the first MI and the estimation of orientation of the first MI.

### Claim 37 (depends on 19)

A system according to claim 19, wherein the first MI comprises a portable scanner configured such as to enable hand-held operation by a user, the scanner for determining the appearance of an object.

### Claim 38 (depends on 19)

A system according to claim 19, wherein the second MI comprises a surveying instrument such as a total station or theodolite.

### Claim 39

(canceled)

### Claim 40

(canceled)

### Claim 41

(canceled)

### Claim 42

(canceled)

### Claim 43

(canceled)

### Claim 44

(canceled)

### Claim 45

(canceled)

### Claim 46 (depends on 19)

A measuring instrument, MI, for scanning a surface or volume of an object to determine appearance of the object, the MI being comprised in a system according to claim 19, wherein the first MI is adapted to transmit optical radiation from the at least one first optical radiation source to and receive optical radiation reflected from a position on the object in order to measure angle and distance to the position on the object, wherein the direction of the transmitted optical radiation and/or the received optical radiation is monitored by consecutively determining position and orientation of the first MI.

### Claim 47 (depends on 46)

The first MI according to claim 46, further comprising a scanning device configured to guide the transmitted optical radiation at predetermined positions over the object.

### Claim 48 (depends on 1)

A method for scanning a surface or a volume of an object to determine appearance of the object with a first measuring instrument, MI, including at least one first optical radiation source configured to emit optical radiation when activated, the method comprising:
transmitting optical radiation from the at least one first optical radiation source to and receiving optical radiation reflected from a position on the object in order to measure angle and distance to the position on the object;
wherein the direction of the transmitted optical radiation and/or the received optical radiation is monitored by determining position and orientation of the first MI by consecutively performing a method according to claim 1.

### Claim 49 (depends on 48)

The method according to claim 48, further comprising:
guiding the transmitted optical radiation at predetermined positions over the object.

### Claim 50 (depends on 16)

A first measuring instrument configured such as to enable operation thereof in a system according to claim 16.

### Claim 51 (depends on 1)

A computer program product comprising computer-executable components for performing a method according to claim 1 when the computer-executable components are executed on a processing unit.

### Claim 52 (depends on 1)

A computer-readable digital storage medium comprising a computer program product comprising computer-executable components adapted to, when executed on a processing unit, perform a method according to claim 1.
