# US 2022/0009516 A1 · Vehicle travel control device

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0009516 A1
- Document ID: US20220009516A1
- Status: Published application
- Kind: A1
- Application number: 17/486,957
- Filed: 2021-09-28
- Published: 2022-01-13
- Earliest claimed: 2019-03-29
- Assignees: Mazda Motor Corporation
- Applicants: Mazda Motor Corporation
- Inventors: Shinsuke SAKASHITA; Daisuke HORIGOME; Masato ISHIBASHI; Eiichi HOJIN
- Web page: https://patentgrep.com/patent/US20220009516A1

## CPC

- B60W 50/14: Means for informing the driver, warning the driver or prompting a driver intervention
- B60W 60/0011: {involving control alternatives for a single driving scenario, e.g. planning several paths to avoid obstacles}
- B60R 1/00: Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
- B60R 1/24: in front of the vehicle
- B60W 30/12: Lane keeping
- B60W 30/14: {Adaptive} cruise control
- B60W 40/10: related to vehicle motion
- B60W 60/0017: {of other traffic participants}
- G06N 3/045: Combinations of networks
- G06N 3/0464: Convolutional networks [CNN, ConvNet]
- G06N 3/09: Supervised learning
- G06N 3/096: Transfer learning
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G06V 20/597: {Recognising the driver's state or behaviour, e.g. attention or drowsiness}
- B60R 2300/105: using multiple cameras
- B60R 2300/304: using merged images, e.g. merging camera image with stored images
- B60R 2300/307: virtually distinguishing relevant parts of a scene from the background of the scene
- B60R 2300/8093: for obstacle warning
- B60W 2050/0028: {Mathematical models, e.g. for simulation}
- B60W 2050/146: {Display means}
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2552/53: Road markings, e.g. lane marker or crosswalk
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G06N: COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING

## Abstract

A vehicle cruise control device includes: an arithmetic circuitry and a device circuitry that controls actuation of traveling devices mounted in a vehicle. The arithmetic circuitry is configured to recognize a vehicle external environment; set a route to be traveled by the vehicle; determine a target motion of the vehicle to follow the set route; and generate an image to be displayed for driving assistance, by using an image taken by the camera and information on the recognized vehicle external environment. The control circuitry is configured to control actuation of one or more traveling devices mounted in the vehicle, based on the target motion determined.

## Claims

### Claim 1

A vehicle cruise control device that controls traveling of a vehicle, the vehicle cruise control device comprising:
an arithmetic circuitry configured to:
recognize a vehicle external environment based on an output from a camera that supplies an image of the vehicle external environment;
set a route to be traveled by the vehicle, in accordance with the vehicle external environment recognized;
determine a target motion of the vehicle to follow the route set; and
generate an image to be displayed for driving assistance, from the image supplied by the camera and information on the vehicle external environment recognized; and
control circuitry configured to control actuation of one or more traveling devices mounted in the vehicle, based on the target motion determined.

### Claim 2 (depends on 1)

The vehicle cruise control device of claim 1, wherein
the arithmetic circuitry is further configured to:
receive information on an obstacle in the vehicle external environment recognized,
generate an image showing a region around the vehicle including the vehicle by combining images supplied by the camera, and
superimpose an indication that emphasizes the obstacle on the image generated to be displayed for driving assistance.

### Claim 3 (depends on 2)

The vehicle cruise control device of claim 2, wherein
the arithmetic circuitry is further configured to:
calculate target physical amounts to be generated by the one or more traveling devices, in order to achieve the target motion determined,
control variables of the one or more traveling devices to achieve the target physical amounts calculated and
output control signals to the one or more traveling devices.

### Claim 4 (depends on 3)

The vehicle cruise control device of claim 3, wherein
the arithmetic circuitry is configured to recognize the vehicle external environment by means of deep learning.

### Claim 5 (depends on 2)

The vehicle cruise control device of claim 2, wherein
the arithmetic circuitry is configured to recognize the vehicle external environment by means of deep learning.

### Claim 6 (depends on 2)

The vehicle cruise control device of claim 2, wherein
the arithmetic circuitry is further configured to convert coordinates of image data from a plurality of cameras around the vehicle and combine the image data to generate the image showing the region around the vehicle including the vehicle.

### Claim 7 (depends on 6)

The vehicle cruise control device of claim 6, wherein
the image showing the region around the vehicle including the vehicle is in plan view.

### Claim 8 (depends on 2)

The vehicle cruise control device of claim 2, wherein
the arithmetic circuitry is further configured to output an image from a forward facing camera and the image showing the region around the vehicle including the vehicle to be displayed for driving assistance.

### Claim 9 (depends on 1)

The vehicle cruise control device of claim 1, wherein
the arithmetic circuitry is configured to recognize the vehicle external environment by means of deep learning.

### Claim 10 (depends on 1)

The vehicle cruise control device of claim 1, wherein
the arithmetic circuitry is further configured to synthesize image data from a plurality of cameras around the vehicle and the vehicle external environment recognized to form a synthesized image to be displayed for driving assistance.

### Claim 11 (depends on 10)

The vehicle cruise control device of claim 10, wherein
the synthesized image is a plan view of the vehicle and the vehicle external environment.

### Claim 12

A vehicle travel control method, comprising:
recognizing a vehicle external environment based on an output from a camera that supplies an image of the vehicle external environment;
setting a route to be traveled by the vehicle, in accordance with the vehicle external environment recognized;
determining a target motion of the vehicle to follow the route set;
generating an image to be displayed for driving assistance, from the image supplied by the camera and information on the vehicle external environment recognized; and
controlling actuation of one or more traveling devices mounted in the vehicle, based on the target motion determined.

### Claim 13 (depends on 12)

The vehicle travel control method of claim 12, wherein generating an image to be displayed for driving assistance includes:
receiving information on an obstacle in the vehicle external environment recognized,
generating an image showing a region around the vehicle including the vehicle by combining images supplied by the camera, and
superimposing an indication that emphasizes the obstacle on the image generated to be displayed for driving assistance.

### Claim 14

A non-transitory computer readable medium having instructions stored therein that once executed by a processor cause the processor to execute a vehicle travel control method, the method comprising:
recognizing a vehicle external environment based on an output from a camera that supplies an image of the vehicle external environment;
setting a route to be traveled by the vehicle, in accordance with the vehicle external environment recognized;
determining a target motion of the vehicle to follow the route set;
generating an image to be displayed for driving assistance, from the image supplied by the camera and information on the vehicle external environment recognized; and
controlling actuation of one or more traveling devices mounted in the vehicle, based on the target motion determined.

### Claim 15 (depends on 14)

The non-transitory computer readable medium of claim 14, wherein generating an image to be displayed for driving assistance includes:
receiving information on an obstacle in the vehicle external environment recognized,
generating an image showing a region around the vehicle including the vehicle by combining images supplied by the camera, and
superimposing an indication that emphasizes the obstacle on the image generated to be displayed for driving assistance.
