# US 2020/0391731 A1 · Advanced driver assistance system, vehicle having the same, and method of controlling the vehicle

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2020/0391731 A1
- Document ID: US20200391731A1
- Status: Published application
- Kind: A1
- Application number: 16/738,437
- Filed: 2020-01-09
- Published: 2020-12-17
- Earliest claimed: 2019-06-11
- Assignees: Mando Corporation
- Applicants: Mando Corporation
- Inventors: Seunghun Cheon
- Web page: https://patentgrep.com/patent/US20200391731A1

## CPC

- B60W 30/09: Taking automatic action to avoid collision, e.g. braking and steering
- B60W 10/18: including control of braking systems
- B60W 10/20: including control of steering systems
- B60W 30/18163: {Lane change; Overtaking manoeuvres}
- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 20/588: {Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road}
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2520/10: Longitudinal speed
- B60W 2552/53: Road markings, e.g. lane marker or crosswalk
- B60W 2554/80: Spatial relation or speed relative to objects
- B60W 2554/801: Lateral distance
- B60W 2554/802: Longitudinal distance
- B60W 2554/804: Relative longitudinal speed
- B60W 2556/50: of positioning data, e.g. GPS [Global Positioning System] data
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

Provided is a vehicle capable of: acquiring an image of a road in front of a vehicle in an autonomous driving mode; recognizing a lane line, a subject lane, and an obstacle on the acquired image of the road; determining whether the recognized obstacle is in a stationary state based on obstacle information detected by an obstacle detector; acquiring, if the obstacle in the stationary state exists on at least one of two subject lane lines constituting the subject lane, a width of the obstacle overlapping the subject lane; determining whether keeping of travelling on the subject lane is to be performed based on the acquired width of the obstacle overlapping the subject lane; performing a deflection control within the subject lane to avoid the obstacle in the stationary state if it is determined that the keeping of travelling on the subject lane is to be performed; and performing control of departure from the subject lane or deceleration control if it is determined that the keeping of travelling on the subject lane is not to be performed.

## Claims

### Claim 1

An advanced driver assistance system comprising:
an image acquisition device configured to acquire an image of a road in front of a vehicle; and
a controller including a processor configured to process the image of the road acquired by the image acquisition device,
wherein the controller is configured to recognize a lane line, a subject lane, and an obstacle, and determine a width of the obstacle overlapping the subject lane, based on the acquired image of the road,
if an obstacle is found to exist on at least one of two subject lane lines constituting the subject lane, output a braking control signal or a route adjusting signal, and
determine whether to cause the vehicle to keep travelling on the subject lane based on a relative value of the determined width of the obstacle overlapping the subject lane relative to a reference width.

### Claim 2 (depends on 1)

The advanced driver assistance system of claim 1, wherein the controller is further configured to determine a width of the obstacle overlapping the subject lane based on the acquired image of the road, and
cause, if the determined width of the obstacle overlapping the subject lane is less than or equal to a reference width, the vehicle to keep travelling on the subject lane and
cause, if the determined width of the obstacle overlapping the subject lane is greater than the reference width, a departure of the vehicle from the subject lane.

### Claim 3 (depends on 2)

The advanced driver assistance system of claim 2, wherein the controller is configured to cause the vehicle to keep travelling on the subject lane by allowing the vehicle to travel on the subject lane by identifying a direction in which the obstacle in the stationary state crosses the subject lane and performing a deflection control in a direction opposite to the identified direction with respect to the subject lane.

### Claim 4 (depends on 2)

The advanced driver assistance system of claim 2, wherein the controller is configured to cause the departure of the vehicle from the subject lane by identifying position information of another obstacle, determining a possibility of collision with the other obstacle based on the identified position information of the other obstacle, and if it is determined that there is no possibility of collision with the other obstacle, causing the vehicle to travel by crossing the subject lane line.

### Claim 5 (depends on 2)

The advanced driver assistance system of claim 2, wherein the controller is configured to cause the departure of the vehicle from the subject lane by identifying position information of another obstacle, determining a possibility of collision with the other obstacle based on the identified position information of the other obstacle, and if it is determined that there is a possibility of collision with the other obstacle, causing the vehicle to change lanes.

### Claim 6 (depends on 2)

The advanced driver assistance system of claim 2, wherein the controller is configured to identify a state of the obstacle that crosses the subject lane line, and if a state of the obstacle is changed from a stationary state to a travelling state, identify a variation of the width of the obstacle overlapping the subject lane, and if the identified width of the obstacle overlapping the subject lane increases, cause the vehicle to change lane.

### Claim 7 (depends on 1)

The advanced driver assistance system of claim 1, wherein the controller is configured to
determine a width of the obstacle overlapping the subject lane based on the acquired image of the road,
determine whether to cause the vehicle to keep travelling on the subject lane based on the determined width of the obstacle overlapping the subject lane, and cause departure of the vehicle from the lane if the vehicle is not to be caused to keep travelling on the subject lane, and
in the causing of the departure of the vehicle from the lane, determine a possibility of collision with another obstacle based on position information of the other obstacle, and cause deceleration if it is determined that there is a possibility of collision with the other obstacle.

### Claim 8 (depends on 1)

The advanced driver assistance system of claim 1, further comprising an obstacle detector configured to detect an obstacle,
wherein the controller is configured to acquire position information of an obstacle based on obstacle information detected by the obstacle detector, and determine whether the obstacle is in a stationary state based on the acquired position information of the obstacle.

### Claim 9

A vehicle comprising:
an image acquisition device configured to acquire an image of a road in front of a vehicle;
a non-image sensor including a LiDAR sensor and a radar sensor;
a controller including a processor configured to process the image of the road acquired by the image acquisition device and data sensed by the non-image sensor;
a steering system configured to perform steering in response to a command of the controller; and
a braking system configured to perform braking in response to a command of the controller,
wherein the controller is configured to,
recognize a lane line, a subject lane, and an obstacle, and determine a width of the obstacle overlapping the subject lane, based on the acquired image of the road,
determine whether the recognized obstacle exists on at least one of two subject lane lines constituting the subject lane, and
output a braking control signal or a route adjusting signal to the braking system or the steering system depending on a value of the determined width of the obstacle overlapping the subject lane relative to a reference width.

### Claim 10 (depends on 9)

The vehicle of claim 9, wherein the controller is configured to determine whether to cause the vehicle to keep travelling on the subject lane is to be performed based on the acquired width of the obstacle overlapping the subject lane, and if the vehicle is not to be caused to keep travelling in the subject lane, output a deflection control signal to avoid the obstacle in the stationary state.

### Claim 11 (depends on 10)

The vehicle of claim 10, wherein the controller is configured to output the deflection control signal by identifying a direction of the obstacle in the stationary state and cause a deflection in a direction opposite to the identified direction with respect to the subject lane.

### Claim 12 (depends on 10)

The vehicle of claim 10, wherein the controller is configured to cause the departure of the vehicle from the subject lane to avoid the obstacle in the stationary state if it is determined that the vehicle is not to be caused to keep travelling on the subject lane.

### Claim 13 (depends on 12)

The vehicle of claim 12, wherein the controller is configured to cause the departure of the vehicle from the subject lane by determining a possibility of collision with another obstacle, and if it is determined that there is no possibility of collision with the other obstacle, causing the vehicle to travel by crossing the subject lane line.

### Claim 14 (depends on 12)

The vehicle of claim 12, wherein of the controller is configured to cause the departure of the vehicle from the subject lane by determining a possibility of collision with another obstacle, and if it is determined that there is no possibility of collision with the other obstacle, causing the vehicle to change lanes.

### Claim 15 (depends on 12)

The vehicle of claim 12, wherein the controller is configured to identify a variation of the determined width of the obstacle overlapping the subject lane if a state of the obstacle crossing the subject lane line is changed from a stationary state to a travel state, and cause the vehicle to change lane if the identified width of the obstacle overlapping the subject lane increases.

### Claim 16

A method of controlling a vehicle, the method comprising:
acquiring an image of a road in front of a vehicle in an autonomous driving mode;
recognizing a lane line, a subject lane, and an obstacle based on the acquired image of the road;
determining, if the obstacle exists on at least one of two subject lane lines constituting the subject lane, a width of the obstacle overlapping the subject lane;
determining whether to cause the vehicle to keep travelling on the subject lane based on the determined width of the obstacle overlapping the subject lane;
causing, if the vehicle is to be caused to keep travelling on the subject lane, a deflection of the vehicle within the subject lane to avoid the obstacle; and
causing, if the vehicle is not to be caused to keep travelling on the subject lane, departure of the vehicle from the subject lane or deceleration of the vehicle.

### Claim 17 (depends on 16)

The method of claim 16, wherein the causing a deflection of the vehicle within the subject lane includes identifying a direction of the obstacle in the stationary state and causing a deflection in a direction opposite to the identified direction with respect to the subject lane.

### Claim 18 (depends on 16)

The method of claim 16, wherein the causing the departure from the subject lane includes:
determining a possibility of collision with another obstacle; and
causing, if it is determined that there is no possibility of collision with the other obstacle, the vehicle to travel by crossing the subject lane line.

### Claim 19 (depends on 16)

The method of claim 16, wherein the causing the departure from the subject lane includes:
determining a possibility of collision with another obstacle in the controlling of the departure from the subject lane; and
causing, if it is determined that there is no possibility of collision with the other obstacle, the vehicle to change lanes.

### Claim 20 (depends on 16)

The method of claim 16, further comprising, identifying, if a state of the obstacle crossing the subject lane line is changed from a stationary state to a travel state, a variation of the determined width of the obstacle overlapping the subject lane, and causing, if the width of the obstacle overlapping the subject lane increases, lane change.

### Claim at position 21

21-22. (canceled)
