# US 2006/0152589 A1 · Imaging and measurement system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2006/0152589 A1
- Document ID: US20060152589A1
- Status: Published application
- Kind: A1
- Application number: 10/528,990
- Filed: 2003-09-25
- Published: 2006-07-13
- Earliest claimed: 2002-09-25
- Inventors: Steven Morrison; Stuart Clarke; Laurence Linnett
- Web page: https://patentgrep.com/patent/US20060152589A1

## CPC

- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 7/30: Determination of transform parameters for the alignment of images, i.e. image registration
- G06T 7/74: {involving reference images or patches}
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06V 10/147: Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19)
- G06V 10/16: {using multiple overlapping images; Image stitching}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Apparatus and method for presenting a highly spatially accurate visualisation of a scene from which measurements can be taken. A sensor is located in relation to a camera, and provides positional characteristics of the camera as it collects frames of video images. Using the positional characteristics the frames are corrected. The corrected frames are then synchronised to form an accurate mosaic of a scene. Example embodiments are described where the moving camera is used to survey or inspect underwater apparatus, roads, runways, railways, crime or accident scenes, archaeological digs and the inside of boilers, chimneys and pipelines.

## Claims

### Claim at position 1

1-25. (canceled)

### Claim 26

An apparatus for presenting a highly spatially accurate visualization of a scene from which measurements can be taken, the apparatus comprising:
at least one camera for recording a plurality of frames of video images of the scene;
at least one sensor mounted in relation to the camera for recording sensor data on positional characteristics of the camera as the at least one camera is moved with respect to the scene; and
image processing means including a first module for synchronizing the frames with the sensor data to form corrected frames, and a second module for constructing an accurate mosaic from the corrected frames.

### Claim 27 (depends on 26)

The apparatus as claimed in claim 26, wherein the at least one camera is a video camera capturing two dimensional digital images.

### Claim 28 (depends on 26)

The apparatus as claimed in claim 26, wherein the at least one sensor comprises a sensor capable of making a positional measurement.

### Claim 29 (depends on 28)

The apparatus as claimed in claim 28, wherein the at least one sensor comprises a digital compass.

### Claim 30 (depends on 28)

The apparatus as claimed in claim 28, wherein the at least one sensor comprises an altimeter and/or bathymetric sensor.

### Claim 31 (depends on 26)

The apparatus as claimed in claim 26, wherein the at least one camera and the at least one sensor are mounted on a moving platform.

### Claim 32 (depends on 26)

The apparatus as claimed in claim 26, wherein the apparatus further includes a calibration system from which the at least one camera is calibrated.

### Claim 33 (depends on 26)

The apparatus as claimed in claim 26, wherein the first module performs a perspective correction to the images using the sensor data.

### Claim 34 (depends on 26)

The apparatus as claimed in claim 26, wherein the second module accomplishes video mosaicing via a correlation technique based on frequency contents of the images being compared.

### Claim 35 (depends on 26)

The apparatus as claimed in claim 26, wherein the apparatus further includes display means for providing a visual image of the mosaic.

### Claim 36 (depends on 26)

The apparatus as claimed in claim 26, wherein the apparatus further comprises data storage means to allow the mosaic to be stored.

### Claim 37 (depends on 26)

The apparatus as claimed in claim 26, wherein the apparatus includes a graphic user interface (GUI).

### Claim 38

A method for presenting a highly spatially accurate visualization of a scene from which measurements can be taken, the method comprising:
(a) recording a plurality of frames of video images of the scene from a camera;
(b) recording sensor data on positional characteristics of the camera as the camera is moved with respect to the scene;
(c) synchronizing the frames with the sensor data to form corrected frames; and
(d) constructing an accurate mosaic from the corrected frames.

### Claim 39 (depends on 38)

The method as claimed in claim 38, wherein the method includes a step of calibrating the camera prior to performing step (a).

### Claim 40 (depends on 38)

The method as claimed in claim 38, wherein the synchronization step includes the step of performing a perspective correction to the images using the sensor data.

### Claim 41 (depends on 38)

The method as claimed in claim 38, wherein the step of video mosaicing is achieved using a correlation technique based on frequency contents of the images being compared.

### Claim 42 (depends on 38)

The method as claimed in claim 38, wherein the method further includes the step of providing a visual image of the mosaic.

### Claim 43 (depends on 38)

The method as claimed in claim 38, wherein the method further includes the step of taking a measurement from the visual image.

### Claim 44 (depends on 38)

The method as claimed in claim 38, wherein the method includes the step of storing the images so that they may be accessed by spatial position.

### Claim 45

A method of performing a survey in a fluid, the method comprising:
(a) mounting a camera and a plurality of sensors on a platform capable of movement in the fluid;
(b) moving the platform through the fluid while recording visual images on the camera and recording sensor data relating to the attitude and distance of the platform from objects of interest within the fluid;
(c) synchronizing the visual images to the sensor data to provide corrected visual images relating to a fixed distance and attitude; and
(d) video mosaicing the images to form an accurate video mosaic as a visual image of the scene surveyed.

### Claim 46 (depends on 45)

The method as claimed in claim 45, wherein the method includes the step of pre-calibrating the camera to compensate for distorting artifacts inherent within the camera.

### Claim 47 (depends on 45)

The method as claimed in claim 45, wherein the method includes the step of displaying the visual image.

### Claim 48 (depends on 45)

The method as claimed in claim 45, wherein the method includes the step of taking a measurement from the visual image.

### Claim 49 (depends on 45)

The method as claimed in claim 45, wherein the platform is mounted on a remotely operated vehicle (ROV).

### Claim 50 (depends on 45)

The method as claimed in claim 45, wherein the method includes the step of storing the mosaiced images for viewing later.
