# US 2020/0393574 A1 · Navigation device, vslam correcting method, method of estimating spatial information, vslam correcting program, and spatial information estimating program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0393574 A1
- Document ID: US20200393574A1
- Status: Published application
- Kind: A1
- Application number: 17/005,404
- Filed: 2020-08-28
- Published: 2020-12-17
- Earliest claimed: 2018-02-28
- Assignees: Furuno Electric Co., Ltd.
- Applicants: Furuno Electric Co., Ltd.
- Inventors: Hiraku NAKAMURA; Hiroyuki TODA; Tatsuya SONOBE; Naomi FUJISAWA
- Web page: https://patentgrep.com/patent/US20200393574A1

## CPC

- G01C 21/203: {specially adapted for water-borne vessels}
- G01S 19/485: {whereby the further system is an optical system or imaging system}
- G01C 21/005: {with correlation of navigation data from several sources, e.g. map or contour matching (G01C21/30 takes precedence)}
- G01S 19/06: employing an initial estimate of the location of the receiver as aiding data or in generating aiding data
- G01S 19/42: Determining position
- G01S 19/45: by combining measurements of signals from the satellite radio beacon positioning system with a supplementary measurement
- G01S 19/53: Determining attitude
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G01S 19/52: Determining velocity
- G06T 2207/10016: Video; Image sequence
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

The device and method can calculate an absolute spatial relationship between a device and other characteristic points etc. with high precision by using VSLAM. A navigation device includes a VSLAM calculating module, a GNSS rate calculating module, and a scale correction value calculating module. The GNSS rate calculating module calculates a GNSS rate based on one of an amount of change in a phase of a GNSS signal and an amount of change in a frequency of the GNSS signal. The VSLAM calculating module estimates VSLAM locations at a plurality of time points based on a VSLAM calculation using a video image. The scale correction value calculating module calculates a scale correction value for the VSLAM location based on the VSLAM locations at two or more time points of the plurality of time points estimated by the VSLAM calculating module, and the GNSS rate.

## Claims

### Claim 1

A navigation device, comprising:
processing circuitry configured to:
calculate a GNSS rate based on one of an amount of change in a phase of a GNSS signal that is a positioning signal transmitted from a positioning satellite and an amount of change in a frequency of the GNSS signal;
estimate VSLAM locations at a plurality of time points based on a VSLAM calculation using a video image; and
calculate a scale correction value for the VSLAM location based on the VSLAM locations at two or more time points of the plurality of time points estimated by the processing circuitry and the GNSS rate.

### Claim 2 (depends on 1)

The navigation device of claim 1, wherein the processing circuitry is further configured to:
calculate a GNSS attitude angle based on an accumulated value of the phase of the GNSS signal; and
calculate a correction value for a VSLAM attitude angle based on VSLAM attitude angles at two or more time points of the plurality of time points estimated by the processing circuitry and the GNSS attitude angle.

### Claim 3 (depends on 2)

The navigation device of claim 2, wherein the processing circuitry is further configured to:
perform a lever arm correction in which the GNSS rate corresponds to coordinates of the VSLAM calculation based on the GNSS attitude angle; and
output the GNSS rate after the lever arm correction to the processing circuitry.

### Claim 4 (depends on 2)

The navigation device of claim 2, wherein the processing circuitry is further configured to optimize the VSLAM calculation based on the GNSS rate and the GNSS attitude angle.

### Claim 5 (depends on 1)

The navigation device of claim 1, wherein the processing circuitry is further configured to correct spatial information estimated by the processing circuitry based on the scale correction value.

### Claim 6 (depends on 4)

The navigation device of claim 4, wherein the processing circuitry is further configured to correct spatial information estimated by the processing circuitry based on the scale correction value and the correction value for the VSLAM attitude angle.

### Claim 7 (depends on 5)

The navigation device of claim 5, wherein the processing circuitry is further configured to generate navigational support information based on the spatial information outputted from the processing circuitry.

### Claim 8 (depends on 7)

The navigation device of claim 7, wherein the navigational support information is image data in which map data obtained from the spatial information and navigational data obtained from an observation result of the GNSS signal containing the GNSS rate overlap with each other.

### Claim 9 (depends on 1)

The navigation device of claim 1, wherein the phase and the frequency of the GNSS signal are a phase and a frequency of a carrier signal.

### Claim 10

A VSLAM correcting method, comprising:
calculating a GNSS rate based on one of an amount of change in a phase of a GNSS signal that is a positioning signal transmitted from a positioning satellite and an amount of change in a frequency of the GNSS signal;
estimating VSLAM locations at a plurality of time points based on a VSLAM calculation using a video image; and
calculating a scale correction value for the VSLAM location based on the VSLAM locations at two or more time points of the plurality of time points estimated by the VSLAM calculation and the GNSS rate.

### Claim 11 (depends on 10)

The VSLAM correcting method of claim 10, further comprising:
calculating a GNSS attitude angle using an accumulated value of the phase of the GNSS signal;
estimating VSLAM attitude angles at a plurality of time points based on the VSLAM calculation; and
calculating a correction value for the VSLAM attitude angle based on the estimated VSLAM attitude angles at two or more time points of the plurality of time points and the GNSS attitude angle.

### Claim 12

A non-transitory computer-readable medium having stored thereon computer-executable instructions which, when executed by a computer, cause the computer to:
calculate a GNSS rate based on one of an amount of change in a phase of a GNSS signal that is a positioning signal transmitted from a positioning satellite and an amount of change in a frequency of the GNSS signal;
estimate VSLAM locations at a plurality of time points based on a VSLAM calculation using a video image; and
calculate a scale correction value for the VSLAM location based on the VSLAM locations at two or more time points of the plurality of time points estimated by the VSLAM calculation and the GNSS rate.

### Claim 13 (depends on 12)

The non-transitory computer-readable medium of claim 12, wherein the instructions further cause the computer to:
calculate a GNSS attitude angle based on an accumulated value of the phase of the GNSS signal;
estimate VSLAM attitude angles at a plurality of time points based on the VSLAM calculation; and
calculate a correction value for the VSLAM attitude angle based on the estimated VSLAM attitude angles at two or more time points of the plurality of time points, and the GNSS attitude angle.

### Claim 14 (depends on 3)

The navigation device of claim 3, wherein the processing circuitry is further configured to optimize the VSLAM calculation based on the GNSS rate and the GNSS attitude angle.

### Claim 15 (depends on 2)

The navigation device of claim 2, wherein the processing circuitry is further configured to correct spatial information estimated by the processing circuitry based on the scale correction value.

### Claim 16 (depends on 3)

The navigation device of claim 3, wherein the processing circuitry is further configured to correct spatial information estimated by the processing circuitry based on the scale correction value and the correction value for the VSLAM attitude angle.

### Claim 17 (depends on 6)

The navigation device of claim 6, wherein the processing circuitry is further configured to generate navigational support information based on the spatial information outputted from the processing circuitry.

### Claim 18 (depends on 2)

The navigation device of claim 2, wherein the phase and the frequency of the GNSS signal are a phase and a frequency of a carrier signal.

### Claim 19 (depends on 3)

The navigation device of claim 3, wherein the processing circuitry is further configured to correct spatial information estimated by the processing circuitry based on the scale correction value.

### Claim 20 (depends on 4)

The navigation device of claim 4, wherein the processing circuitry is further configured to correct spatial information estimated by the processing circuitry based on the scale correction value and the correction value for the VSLAM attitude angle.
