# US 2017/0285649 A1 · Autonomous vehicle with improved visual detection ability

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0285649 A1
- Document ID: US20170285649A1
- Status: Published application
- Kind: A1
- Application number: 15/352,891
- Filed: 2016-11-16
- Published: 2017-10-05
- Earliest claimed: 2016-03-29
- Assignees: Adasworks Kft.
- Applicants: AdasWorks Kft.
- Inventors: Gergely DEBRECZENI
- Web page: https://patentgrep.com/patent/US20170285649A1

## CPC

- G05D 1/0246: {using a video camera in combination with image processing means}
- B60W 30/0956: {the prediction being responsive to traffic or environmental parameters}
- B60W 30/12: Lane keeping
- B60W 60/001: {Planning or execution of driving tasks}
- G05D 1/00: Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots (drive control systems specially adapted for autonomous road vehicles B60W60/00)
- G05D 1/0278: {using satellite positioning signals, e.g. GPS}
- G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
- G08G 1/16: Anti-collision systems (road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08)
- H04N 5/77: between a recording apparatus and a television camera
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2552/35: Road bumpiness, e.g. potholes
- B60W 2552/53: Road markings, e.g. lane marker or crosswalk
- B60W 2554/00: Input parameters relating to objects
- B60W 2554/4029: Pedestrians
- B60W 2720/24: Direction of travel
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

The invention provides an autonomous vehicle capable of driving independently through a path of intense traffic and transporting objects or people, even on rough surfaces, whilst ensuring safety of the vehicle and general road safety. The autonomous vehicle includes at least one variable pitch camera for producing images to be used for a computer vision to control the autonomous vehicle. The invention facilitates changing the pitch of the variable pitch camera to maximise camera image clarity and/or resolution as the autonomous vehicle moves. The images can be used for lane detection, pedestrian detection, three-dimensional (3D) reconstruction of an environment and/or pothole detection. With the invention, at least one image from the variable pitch camera is used in controlling the movement and/or the trajectory of the autonomous vehicle.

## Claims

### Claim 1

An autonomous vehicle (100), comprising at least one camera (110, 111, or 112) configured to produce images (141, 142, 143, or 144) for the computer vision used to control the autonomous vehicle (100), wherein,
at least one said camera (110, 111, 112, or 113) has a variable and movable pitch, yaw and/or roll to the direction of travel that is configured to be controlled,
the pitch, yaw and/or roll of at least one camera (110, 111, 112, or 113) is configured to be changed to maximise camera image clarity and/or resolution as said autonomous vehicle moves,
at least one image (141, 142, 143, or 144) from the variable pitch, yaw and/or roll camera (110, 111, 112, or 113) is configured to be used in controlling the movement of the autonomous vehicle (100).

### Claim 2 (depends on 1)

An autonomous vehicle (100) as claimed in claim 1, characterised in that, at least one said camera (110, 111, 112, or 113) is configured to be used in any of the following: lane detection, pedestrian detection, general 3D reconstruction of the environment and/or pothole detection.

### Claim 3 (depends on 1)

An autonomous vehicle (100) as claimed in claim 1, characterised in that, the variable pitch, yaw and/or roll of the camera (110, 111, 112, or 113) is controlled based on any of the following: camera position, camera orientation and/or speed of said vehicle, and/or output of image processing algorithm of the camera (100).

### Claim 4 (depends on 1)

An autonomous vehicle (100) as claimed in claim 1, characterised in that, the the variable pitch, yaw and/or roll of the camera (110, 111, 112, or 113) is controlled based on any of the following: weather and/or traffic situation.

### Claim 5 (depends on 1)

An autonomous vehicle (100) as claimed in claim 1, characterised in that, the said plurality of cameras (110, 111, 112, or 113) are located in different parts of the autonomous vehicle (100) and are configured to perform different tasks.

### Claim 6 (depends on 5)

An autonomous vehicle (100) as claimed in claim 5, characterised in that, each of the said tasks is configured to be completed at a different camera position and/or orientation.

### Claim 7 (depends on 1)

An autonomous vehicle (100) as claimed in claim 1, characterised in that, at least one camera output is configured to be processed by an Artificial Intelligence and detection module (410).

### Claim 8 (depends on 7)

An autonomous vehicle (100) as claimed in claim 7, characterised in that, the Artificial Intelligence and detection module (410) is configured to send steering control commands to a Steering unit (430).

### Claim 9 (depends on 8)

An autonomous vehicle (100) as claimed in claim 8, characterised in that, the Steering unit (430) is configured to use vehicle speed and/or gyroscope data to control and alter the pitch, yaw and/or roll angle of at least one said camera (110, 111, 112, or 113).

### Claim 10 (depends on 9)

An autonomous vehicle (100) as claimed in claim 9, characterised in that, the Steering unit (430) is configured to use any of the following: vehicle speed, output of the imaging algorithm, mapping info, GPS and/or gyroscope data to control and alter the pitch, yaw and/or roll angle of at least one said camera (110, 111, 112, or 113) repeatedly in a closed loop, and optionally the improved detection performance is configured to be used to feed the control logic of the autonomous vehicle (100).

### Claim 11

A method for controlling an autonomous vehicle (100), comprising at least one camera (110, 111, 112, or 113) configured to produce images (141, 142, 143, or 144) for the computer vision used to control the autonomous vehicle (100), comprising the following steps,
at least one said camera (110, 111, 112, or 113) has a variable and movable pitch, yaw and/or roll to the direction of travel that is controlled,
the pitch, yaw and/or roll of at least one camera (110, 111, 112, or 113) is changed to maximise camera image clarity and/or resolution as said autonomous vehicle (100) moves,
at least one image (141, 142, 143, or 144) from the variable pitch, yaw and/or roll camera (110, 111, 112, or 113) is used in controlling the movement of the autonomous vehicle (100).

### Claim 12 (depends on 11)

A method as claimed in claim 11, characterised in that, at least one said camera (110, 111, 112, or 113) is used in any of the following: lane detection, pedestrian detection, general 3D reconstruction of the environment and/or pothole detection.

### Claim 13 (depends on 11)

A method as claimed in claim 11, characterised in that, the pitch, yaw and/or roll of the camera (110, 111, 112, or 113) is controlled based on any of the following: camera position, camera orientation and/or speed of said vehicle, and/or output of image processing algorithm of the camera (100).

### Claim 14 (depends on 11)

A method as claimed in claim 11, characterised in that, the pitch of the variable pitch, yaw and/or roll camera (110, 111, 112, or 113) is controlled based on any of the following: weather and/or traffic situation.

### Claim 15 (depends on 11)

A method as claimed in claim 11, characterised in that, the said plurality of cameras (110, 111, 112, or 113) are located in different parts of the autonomous vehicle (100) and performing different tasks,

### Claim 16 (depends on 15)

A method as claimed in claim 15, characterised in that, each of the said tasks is completed at a different camera position and/or orientation.

### Claim 17 (depends on 11)

A method as claimed in claim 11, characterised in that, at least one camera output is processed by an Artificial Intelligence and detection module (410).

### Claim 18 (depends on 11)

A method as claimed in claim 11, characterised in that, the output of the Artificial Intelligence and detection module (410) sends steering control commands to a Steering unit (430).

### Claim 19 (depends on 18)

A method as claimed in claim 18, characterised in that, the Steering unit (430) uses vehicle speed and/or gyroscope data to control and alter the pitch, yaw and/or roll angle of at least one said camera (110, 111, 112, or 113).

### Claim 20 (depends on 19)

A method as claimed in claim 19, characterised in that, the Steering unit (430) uses vehicle speed, output of the imaging algorithm, mapping info, GPS and/or gyroscope data to control and alter the pitch, yaw and/or roll angle of at least one said camera (110, 111, 112, or 113) repeatedly in a closed loop, and optionally the improved detection performance is used to feed the control logic of the autonomous vehicle (100).

### Claim 21

A software program product stored on a non-transient memory medium for controlling an autonomous vehicle (100), comprising at least one camera software configured to produce images (141, 142, 143, or 144) for the computer vision software used to control the autonomous vehicle (100), wherein,
at least one said camera (110, 111, 112, or 113) has a variable and movable pitch, yaw and/or roll to the direction of travel that is configured to be controlled,
the pitch, yaw and/or roll of at least one camera (110, 111, 112, or 113) is configured to be changed to maximise camera image clarity and/or resolution as said autonomous vehicle (100) moves,
at least one image (141, 142, 143, or 144) from the variable pitch, yaw and/or roll camera (110, 111, 112, or 113) is configured to be used in controlling the movement of the autonomous vehicle (100).

### Claim 22 (depends on 21)

A software program product as claimed in claim 21, characterised in that, at least one said camera (110, 111, 112, or 113) is configured to be used in any of the following: lane detection, pedestrian detection, general 3D reconstruction of the environment and/or pothole detection.

### Claim 23 (depends on 21)

A software program product as claimed in claim 21, characterised in that, the pitch, yaw and/or roll of the camera (110, 111, 112, or 113) is controlled based on any of the following: camera position, camera orientation and/or speed of said vehicle (100), and/or output of image processing algorithm of the camera.

### Claim 24 (depends on 21)

A software program product as claimed in claim 21, characterised in that, the pitch of the variable pitch camera (110, 111, 112, or 113) is controlled based on any of the following: weather and/or traffic situation.

### Claim 25 (depends on 21)

A software program product as claimed in claim 21, characterised in that, the said plurality of cameras (110, 111, 112, or 113) are located in different parts of the autonomous vehicle (100) and are configured to perform different tasks.

### Claim 26 (depends on 25)

A software program product as claimed in claim 25, characterised in that, each of the said tasks is configured to be completed at a different camera position and/or orientation.

### Claim 27 (depends on 21)

A software program product as claimed in claim 21, characterised in that, at least one camera output is configured to be processed by an Artificial Intelligence and detection module (410).

### Claim 28 (depends on 27)

A software program product as claimed in claim 27, characterised in that, the Artificial Intelligence and detection module (410) is configured to send steering control commands to a Steering unit (430).

### Claim 29 (depends on 28)

A software program product as claimed in claim 28, characterised in that, the Steering unit (430) is configured to use vehicle speed and/or gyroscope data to control and alter the pitch angle of at least one said camera (110, 111, 112, or 113).

### Claim 30 (depends on 29)

A software program product as claimed in claim 29, characterised in that, the Steering unit (430) is configured to use vehicle speed, output of the imaging algorithm, mapping info, GPS and/or gyroscope data to control and alter the pitch, yaw and/or roll angle of at least one said camera (110, 111, 112, or 113) repeatedly in a closed loop, and optionally the improved detection performance is configured to be used to feed the control logic of the autonomous vehicle (100).
