# US 2021/0279484 A1 · Lane estimation device, method, and program

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0279484 A1
- Document ID: US20210279484A1
- Status: Published application
- Kind: A1
- Application number: 17/255,838
- Filed: 2019-06-20
- Published: 2021-09-09
- Earliest claimed: 2018-06-27
- Assignees: Nippon Telegraph and Telephone Corporation
- Applicants: Nippon Telegraph and Telephone Corporation
- Inventors: Kohei MORI; Ippei SHAKE; Yuki YOKOHATA; Manabu YOSHIDA
- Web page: https://patentgrep.com/patent/US20210279484A1

## CPC

- G06T 7/11: Region-based segmentation
- B60W 30/12: Lane keeping
- B60W 30/18163: {Lane change; Overtaking manoeuvres}
- B60W 40/06: Road conditions
- G06T 7/13: Edge detection
- G06V 10/255: {Detecting or recognising potential candidate objects based on visual cues, e.g. shapes}
- G06V 10/44: Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- B60W 2552/10: Number of lanes
- B60W 2552/53: Road markings, e.g. lane marker or crosswalk
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20081: Training; Learning
- G06T 2207/20084: Artificial neural networks [ANN]
- G06T 2207/30256: Lane; Road marking
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A technology is provided whereby a lane can be correctly estimated without relying on lane markers. A shape indicating a road region is extracted from image data obtained by capturing images in the progression direction of a vehicle 6 and, on the basis of information indicating the shape, the angle of inclination for one contour line, the center-of-gravity coordinates for a diagram indicating the shape of the road region, the angle between two consecutive contour lines across one vertex of the diagram indicating the shape, and the area of the diagram indicating the shape are calculated as feature values for the shape of the road region. In addition, the lane in which the vehicle 6 is traveling can be estimated by determining whether or not the calculated feature values are included in a threshold value range preset for each lane.

## Claims

### Claim 1

A lane estimation device comprising a processor and a memory connected to the processor, the processor configured to:
acquire image data obtained by imaging a range including a road region in which a moving object is moving, and store the acquired image data in the memory; and
read out the image data stored in the memory, recognize a shape indicating the road region from the image data, and calculate a feature value of the road region based on the recognized shape; and
estimate a lane in which the moving object is moving based on the calculated feature value.

### Claim 2 (depends on 1)

The lane estimation device according to claim 1, wherein the processor is further configured to:
calculate, based on the recognized shape indicating the road region, an inclination angle of a contour line thereof as the feature value of the road region; and
estimate the lane in which the moving object is moving by determining which threshold value range preset for each lane the calculated inclination angle of the contour line is included in.

### Claim 3 (depends on 1)

The lane estimation device according to claim 1, wherein the processor is further configured to:
calculate, based on the recognized shape indicating the road region, at least one of center-of-gravity coordinates for a diagram indicating the shape, an angle of one vertex of the diagram indicating the shape or an angle of one vertex of a virtual diagram derived from the diagram, and an area of the diagram indicating the shape; and
estimate the lane in which the moving object is moving by determining which threshold value range preset for each lane the calculated center-of-gravity coordinates for the diagram, vertex angle, and diagram area are included in.

### Claim 4 (depends on 1)

The lane estimation device according to claim 1, wherein the processor is further configured to:
calculate, based on the recognized shape indicating the road region, at least one of an angle between two sides of a diagram obtained by converting the shape into a triangle having one side in a vertical direction of a screen indicated by the image data, or an area of the converted diagram, as the feature value; and
estimate the lane in which the moving object is moving by determining which threshold value range preset for each lane the calculated angle between contour lines or area of the diagram is included in.

### Claim 5 (depends on 1)

The lane estimation device according to claim 1, wherein the processor is further configured to:
recognize, from the acquired image data, a first shape indicating the road region including an object present on the road region and a second shape indicating a region excluding the object from the road region, respectively, and estimate a contour line of the road region when the object is not present on the basis of the recognized first shape and second shape to calculate an inclination angle of the contour line; and
estimate the lane in which the moving object is moving by determining which threshold value range preset for each lane the calculated inclination angle of the contour line is included in.

### Claim 6 (depends on 1)

The lane estimation device according to claim 1, wherein the processor is further configured to:
acquire, based on the recognized shape indicating the road region, pixel value data labeled for each pixel in the road region as the feature value of the road region; and
estimate the lane in which the moving object is moving by determining which of a plurality of patterns preset for the road region the acquired pixel value data is similar to.

### Claim 7 (depends on 1)

The lane estimation device according to claim 1, wherein the processor is further configured to:
acquire, based on the recognized shape indicating the road region, pixel value data labeled for each pixel in the road region as the feature value of the road region; and
estimate the lane in which the moving object is moving by determining which pattern preset for each lane included in the road region the acquired pixel value data is similar to.

### Claim 8 (depends on 1)

The lane estimation device according to claim 1, wherein the processor is further configured to:
recognize, from the acquired image data, a first shape indicating the road region including an object present on the road region, and acquire pixel value data labeled for each pixel in the first shape; and
estimate the lane in which the moving object is moving by determining which of a plurality of patterns preset for the road region or patterns preset for each lane included in the road region the acquired pixel value data is similar to.

### Claim 9 (depends on 1)

The lane estimation device according to claim 1, wherein the processor is further configured to:
correct, based on at least one of information indicating a lane change history of the moving object estimated from a lane estimation result obtained in the past, information relating to a structure of the road region at a moving position of the moving object, or information indicating a lane change in the road region estimated from a state of movement of the moving object, a currently obtained lane estimation result.

### Claim 10

A lane estimation method for estimating a lane in which a moving object is moving by an information processing device comprising a processor and a memory connected to the processor, the method comprising:
acquiring image data obtained by imaging a range including a road region in which the moving object is moving;
recognizing a shape indicating the road region from the acquired image data and calculating a feature value of the road region based on the recognized shape; and
estimating the lane in which the moving object is moving based on the calculated feature value.

### Claim 11

A non-transitory tangible computer-readable storage medium having stored thereon a program for estimating a lane in which a moving object is moving, the program comprising commands for causing a processor to:
acquire image data obtained by imaging a range including a road region in which the moving object is moving;
recognize a shape indicating the road region from the acquired image data and calculate a feature value of the road region based on the recognized shape; and
estimate the lane in which the moving object is moving based on the calculated feature value.
