# US 2021/0081682 A1 · Self-position estimation device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0081682 A1
- Document ID: US20210081682A1
- Status: Published application
- Kind: A1
- Application number: 17/105,303
- Filed: 2020-11-25
- Published: 2021-03-18
- Earliest claimed: 2018-05-30
- Assignees: Soken, Inc.; Denso Corporation
- Applicants: Soken, Inc.; Denso Corporation
- Inventors: Shunya KUMANO; Takeshi SHIKIMACHI
- Web page: https://patentgrep.com/patent/US20210081682A1

## CPC

- G01C 21/30: Map- or contour-matching
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- B60W 30/12: Lane keeping
- G01C 21/3602: {Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera}
- G01C 21/3658: {Lane guidance}
- G01S 19/42: Determining position
- G01S 19/485: {whereby the further system is an optical system or imaging system}
- G01S 19/49: whereby the further system is an inertial position system, e.g. loosely-coupled
- G01S 19/50: whereby the position solution is constrained to lie upon a particular curve or surface, e.g. for locomotives on railway tracks
- G09B 29/10: Map spot or coordinate position indicators; Map reading aids (optical projection apparatus per se G03B)
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2552/30: Road curve radius
- G06T 2207/30256: Lane; Road marking
- G01C: MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY (measuring liquid level G01F; radio navigation, determining distance or velocity by use of propagation effects, e.g. Doppler effects, propagation time, of radio waves, analogous arrangements using other waves G01S)
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G01S: RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B)
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A self-position estimation device equipped to a vehicle: captures an image of a periphery of the vehicle; detects a state quantity of the vehicle; acquires position information indicating a position of the vehicle from a satellite system; stores map data that defines a map in which a road is expressed by a link and a node; estimate a self-position of the vehicle on the map, as an estimation position, based on the captured image, the state quantity, the position information, and the map data, respectively; recognizes a road section in which a lane quantity increases or decreases based on the captured image; and sets a weighting of the estimation position of the vehicle estimated based on the map data relatively smaller in response to a recognition of the road section in which the lane quantity increases or decreases.

## Claims

### Claim 1

A self-position estimation device equipped to a vehicle and estimating a position of the vehicle, the self-position estimation device comprising:
a vehicle-mounted camera capturing an image of a periphery of the vehicle;
a vehicle state quantity sensor detecting a state quantity of the vehicle;
a satellite positioning acquisition unit acquiring position information indicating a position of the vehicle from a satellite system;
a map data storage storing map data that defines a map in which a road is expressed by a link and a node;
a position estimation unit estimating a self-position of the vehicle on the map, as an estimation position, based on the image captured by the vehicle-mounted camera, the state quantity, the position information, and the map data, respectively;
a lane quantity change determiner recognizing a road section in which a lane quantity increases or decreases based on the image captured by the vehicle-mounted camera; and
a position corrector setting a weighting of the estimation position of the vehicle estimated by the position estimation unit based on the map data to be relatively smaller in response to a recognition of the road section in which the lane quantity increases or decreases compared with a case where the road section in which the lane quantity increases or decreases is not recognized.

### Claim 2 (depends on 1)

The self-position estimation device according to claim 1, wherein
the position corrector corrects the estimation position of the vehicle estimated based on the map data in response to the recognition of the road section in which the lane quantity increases or decreases.

### Claim 3 (depends on 1)

The self-position estimation device according to claim 1, wherein,
in response to the recognition of the road section in which the lane quantity increases or decreases, the position corrector corrects the self-position of the vehicle on the map with reference to the estimation position estimated based on the map data with the weighting set to be relatively smaller, the image captured by the vehicle-mounted camera, the state quantity, and the position information.

### Claim 4 (depends on 2)

The self-position estimation device according to claim 2, wherein
the lane quantity change determiner recognizes a start position of the road section in which the lane quantity increases or decreases with reference to a change in a road width determined based on a recognition of marking lines on the road by the vehicle-mounted camera.

### Claim 5 (depends on 2)

The self-position estimation device according to claim 2, wherein
the lane quantity change determiner recognizes a start position of the road section in which the lane quantity increases or decreases with reference to the lane quantity determined based on a recognition of marking lines on the road by the vehicle-mounted camera.

### Claim 6 (depends on 2)

The self position estimation device according to claim 2, wherein
the lane quantity change determiner recognizes a start position of the road section in which the lane quantity increases or decreases with reference to the self-position of the vehicle estimated by the position estimation unit and a link quantity of the map data.

### Claim 7 (depends on 2)

The self position estimation device according to claim 2, wherein
the lane quantity change determiner recognizes a start position of the road section in which the lane quantity increases or decreases with reference to a shape difference between an own lane along which the vehicle travels and another lane obtained by a recognition of marking lines on the road by the vehicle-mounted camera.

### Claim 8

A self-position estimation device equipped to a vehicle, the self-position estimation device comprising:
a vehicle-mounted camera capturing an image of a periphery of the vehicle;
a vehicle state quantity sensor detecting a state quantity of the vehicle;
a satellite positioning acquisition unit acquiring latitude and longitude of a position of the vehicle from a satellite system;
a map data storage storing map data that defines a map in which a road is expressed by a link and a node; and
a position estimation unit estimating a self-position of the vehicle on the map, as an estimation position, based on the image captured by the vehicle-mounted camera, the state quantity, the latitude and longitude, and the map data, respectively;
wherein the position estimation unit includes:
a lane quantity change determiner recognizing a road section in which a lane quantity increases or decreases based on a sensing of the vehicle-mounted camera; and
a position corrector correcting the estimation position of the vehicle estimated by the position estimation unit based on the map data by setting a weighting of the estimation position of the vehicle estimated based on the map data smaller in response to a recognition of the road section in which the lane quantity increases or decreases compared with a case where the road section in which the lane quantity increases or decreases is not recognized.

### Claim 9 (depends on 8)

The self-position estimation device according to claim 8, wherein
the lane quantity change determiner recognizes a start position of the road section in which the lane quantity increases or decreases with reference to a change in a road width determined based on a recognition of marking lines on the road by the vehicle-mounted camera.

### Claim 10 (depends on 8)

The self-position estimation device according to claim 8, wherein
the lane quantity change determiner recognizes a start position of the road section in which the lane quantity increases or decreases with reference to the lane quantity determined based on a recognition of marking lines on the road by the vehicle-mounted camera.

### Claim 11 (depends on 8)

The self-position estimation device according to claim 8, wherein
the lane quantity change determiner recognizes a start position of the road section in which the lane quantity increases or decreases with reference to the self-position of the vehicle estimated by the position estimation unit and a link quantity of the map data.

### Claim 12 (depends on 8)

The self-position estimation device according to claim 8, wherein
the lane quantity change determiner recognizes a start position of the road section in which the lane quantity increases or decreases with reference to a shape difference between an own lane along which the vehicle travels and another lane obtained by a recognition of marking lines on the road by the vehicle-mounted camera.

### Claim 13

A self-position estimation device equipped to a vehicle and estimating a position of the vehicle, the self-position estimation device comprising:
a vehicle-mounted camera capturing an image of a periphery of the vehicle;
a vehicle state quantity sensor detecting a state quantity of the vehicle, the state quantity of the vehicle including a vehicle speed;
a receiver receiving position information indicating a position of the vehicle from a satellite system;
a map data storage storing map data that defines a map in which a road is expressed by a link and a node; and
a processor, by executing a program stored in a non-transitory computer readable medium, configured to:
estimate a self-position of the vehicle on the map, as an estimation position, based on the image captured by the vehicle-mounted camera, the state quantity of the vehicle, the position information of the vehicle from the satellite system, and the map data, respectively;
recognize a road section in which a lane quantity increases or decreases based on the image captured by the vehicle-mounted camera; and
correct the estimation position of the vehicle estimated based on the map data, in response to a recognition of the road section in which the lane quantity increases or decreases, by setting a weighting of the estimation position of the vehicle estimated based on the map data smaller than a case where the road section in which the lane quantity increases or decreases is not recognized.

### Claim 14 (depends on 13)

The self-position estimation device according to claim 13, wherein
the processor recognizes a start position of the road section in which the lane quantity increases or decreases with reference to a change in a road width determined based on a recognition of marking lines on the road by the vehicle-mounted camera.

### Claim 15 (depends on 13)

The self-position estimation device according to claim 13, wherein
the processor recognizes a start position of the road section in which the lane quantity increases or decreases with reference to the lane quantity determined based on a recognition of marking lines on the road by the vehicle-mounted camera.

### Claim 16 (depends on 13)

The self-position estimation device according to claim 13, wherein
the processor recognizes a start position of the road section in which the lane quantity increases or decreases with reference to the estimated self-position of the vehicle and a link quantity of the map data.

### Claim 17 (depends on 13)

The self-position estimation device according to claim 13, wherein
the processor recognizes a start position of the road section in which the lane quantity increases or decreases with reference to a shape difference between an own lane along which the vehicle travels and another lane obtained by a recognition of marking lines on the road by the vehicle-mounted camera.
