# US 2020/0349362 A1 · Method of Computer Vision Based Localisation and Navigation and System for Performing the Same

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0349362 A1
- Document ID: US20200349362A1
- Status: Published application
- Kind: A1
- Application number: 16/761,765
- Filed: 2018-11-07
- Published: 2020-11-05
- Earliest claimed: 2017-11-10
- Assignees: Horiba Mira Limited
- Applicants: Horiba Mira Limited
- Inventors: Andrew Maloney
- Web page: https://patentgrep.com/patent/US20200349362A1

## CPC

- G01C 21/005: {with correlation of navigation data from several sources, e.g. map or contour matching (G01C21/30 takes precedence)}
- G06V 20/56: exterior to a vehicle by using sensors mounted on the vehicle
- G01C 21/206: {specially adapted for indoor navigation}
- G01C 21/30: Map- or contour-matching
- G01C 21/3815: {Road data}
- G01C 21/3848: {Data obtained from both position sensors and additional sensors}
- G01C 21/3863: {Structures of map data}
- G01S 5/16: using electromagnetic waves other than radio waves
- G05D 1/0246: {using a video camera in combination with image processing means}
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/084: Backpropagation, e.g. using gradient descent
- G06N 3/09: Supervised learning
- G06N 7/01: Probabilistic graphical models, e.g. probabilistic networks
- G06N 20/00: Machine learning
- G06T 7/246: using feature-based methods, e.g. the tracking of corners or segments
- G06T 7/277: involving stochastic approaches, e.g. using Kalman filters
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 7/73: using feature-based methods
- G01S 19/47: the supplementary measurement being an inertial measurement, e.g. tightly coupled inertial
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30244: Camera pose
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

In relation to the field of vehicle navigation, we describe a method of determining a position of a subject (such as a vehicle, platform or target), comprising the steps of obtaining and storing an object dataset comprising object data indicative of one or more objects in an environment, including an indication of object parameters associated with the or each object, the object parameters including one or more of location, orientation, one or more dimensions, and a type associated with the object, obtaining environment data indicative of a region of the environment from a sensor associated with the subject, determining the presence of an observed object in the environment data, including determining one or more equivalent observed object parameters associated with the observed object, and determining the position of the subject based on a comparison of the observed object parameters with the equivalent object parameters of the objects in the object dataset.

## Claims

### Claim 1

A method of determining a position of a subject, comprising the steps of
obtaining and storing an object dataset comprising object data indicative of one or more objects in an environment, including an indication of object parameters associated with the or each object, the object parameters including one or more of location, orientation, one or more dimensions, and a type classification associated with the object,
obtaining environment data indicative of a region of the environment from a sensor associated with the subject,
determining the presence of an observed object in the environment data, including determining one or more equivalent observed object parameters associated with the observed object, and
determining the position of the subject based on a comparison of the observed object parameters with the equivalent object parameters of the objects in the object dataset.

### Claim at position 2

2-18. (canceled)

### Claim 19

A system for determining a position of a subject, comprising:
a storage device configured to store an object dataset comprising object data indicative of one or more objects in an environment, including an indication of object parameters associated with the or each object, the object parameters including one or more of location, orientation, one or more dimensions, and a type classification associated with the object,
a sensor configured to obtain environment data indicative of a region of the environment, an object detection module configured to determine the presence of an observed object in the environment data, including determining one or more equivalent observed object parameters associated with the observed object, and
a position detection module configured to determine the position of the subject based on a comparison of the observed object parameters with the equivalent object parameters of the objects in the object dataset.

### Claim at position 4

20-38. (canceled)
