# US 2021/0276557 A1 · Vehicular trailer hitching assist system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0276557 A1
- Document ID: US20210276557A1
- Status: Published application
- Kind: A1
- Application number: 17/303,188
- Filed: 2021-05-24
- Published: 2021-09-09
- Earliest claimed: 2017-02-01
- Assignees: Magna Electronics Inc.
- Applicants: Magna Electronics Inc.
- Inventors: Nikhil Gupta; Horst D. Diessner; Richard Bozich; Jyothi P. Gali; Aleksandar Stefanovic; Hilda Faraji; Miad Moarref; Xai Phan; Galina Okouneva; Brijendra Kumar Bharti
- Web page: https://patentgrep.com/patent/US20210276557A1

## CPC

- B60D 1/36: for facilitating connection, e.g. hitch catchers
- B60W 30/18036: {Reversing}
- B60D 1/62: involving supply lines, electric circuits or the like
- B60R 1/26: to the rear of the vehicle
- B60W 10/10: including control of change-speed gearings
- B60W 10/18: including control of braking systems
- B60W 10/20: including control of steering systems
- B60W 30/09: Taking automatic action to avoid collision, e.g. braking and steering
- G05D 1/0212: {with means for defining a desired trajectory (involving a plurality of land vehicles G05D1/0287)}
- G05D 1/0246: {using a video camera in combination with image processing means}
- G08G 1/165: {for passive traffic, e.g. including static obstacles, trees}
- G08G 1/166: {for active traffic, e.g. moving vehicles, pedestrians, bikes}
- B60R 2300/30: characterised by the type of image processing
- B60R 2300/305: merging camera image with lines or icons
- B60R 2300/607: from a bird's eye viewpoint
- B60R 2300/8066: for monitoring rearward traffic
- B60R 2300/808: for facilitating docking to a trailer
- B60R 2300/8093: for obstacle warning
- B60W 2300/14: Tractor-trailers, i.e. combinations of a towing vehicle and one or more towed vehicles, e.g. caravans; Road trains
- B60W 2420/403: Image sensing, e.g. optical camera
- B60W 2554/00: Input parameters relating to objects
- B60W 2710/10: Change speed gearings
- B60W 2710/18: Braking system
- B60W 2710/20: Steering systems
- B60W 2720/106: Longitudinal acceleration
- B60W 2720/24: Direction of travel
- B60D: VEHICLE CONNECTIONS
- B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93})

## Abstract

A vehicular trailer hitching assist system includes a camera disposed at a rear portion of a vehicle and viewing at least rearward of the vehicle. An electronic control unit (ECU) includes an image processor operable to process image data captured by the camera. The ECU, via image processing of image data captured by the camera, detects a trailer rearward of the vehicle and determines a first path of travel for the vehicle to follow to maneuver the vehicle toward the trailer and to align the tow ball of the vehicle with a trailer hitch of the trailer. The ECU generates an output to maneuver the vehicle along the determined first path of travel. Responsive to detection of an object entering the first path of travel, the ECU determines a second path of travel for the vehicle to follow that avoids the detected object entering the determined path of travel.

## Claims

### Claim 1

A vehicular trailer hitching assist system, the vehicular trailer hitching assist system comprising:
a camera, wherein the camera is configured to be disposed at a rear portion of a vehicle so as to view at least rearward of the vehicle;
wherein the camera comprises an imaging array having at least one million photosensors arranged in rows and columns;
an electronic control unit (ECU) disposed at the vehicle, the ECU comprising an image processor operable to process image data captured by the camera with the camera disposed at the rear portion of the vehicle;
wherein, with the camera disposed at the rear portion of the vehicle, the ECU, via image processing by the image processor of image data captured by the camera, detects a trailer that is present rearward of the vehicle and determines a first path of travel for the vehicle to follow to maneuver the vehicle toward the trailer and to align a tow ball of the vehicle with a trailer hitch of the trailer as the vehicle approaches the trailer;
wherein the ECU, responsive to determination of the first path of travel, generates an output to maneuver the vehicle along the determined first path of travel;
wherein, with the camera disposed at the rear portion of the vehicle and with the vehicle maneuvering along the determined first path of travel, the ECU, at least via image processing by the image processor of image data captured by the camera, detects an object entering the determined first path of travel; and
wherein, with the camera disposed at the rear portion of the vehicle, and responsive to the detection of the object entering the determined first path of travel, the ECU, at least via image processing by the image processor of image data captured by the camera, determines a second path of travel for the vehicle to follow that avoids the detected object.

### Claim 2 (depends on 1)

The vehicular trailer hitching assist system of claim 1, wherein the ECU performs object detection when a determined trailer position is greater than a threshold distance from the vehicle.

### Claim 3 (depends on 1)

The vehicular trailer hitching assist system of claim 1, wherein the ECU determines a third path of travel responsive to detection of an object in the determined second path of travel.

### Claim 4 (depends on 1)

The vehicular trailer hitching assist system of claim 1, wherein the ECU, responsive to determination of the second path of travel, adjusts the output to maneuver the vehicle along the determined second path of travel and to avoid the detected object and to align the tow ball of the vehicle with the trailer hitch of the trailer as the vehicle approaches the trailer.

### Claim 5 (depends on 4)

The vehicular trailer hitching assist system of claim 4, wherein, responsive to determination that the detected object moves out of the determined first path of travel, the ECU adjusts the output to maneuver the vehicle along the determined first path of travel.

### Claim 6 (depends on 1)

The vehicular trailer hitching assist system of claim 1, wherein the ECU, with the camera disposed at the rear portion of the vehicle and via image processing by the image processor of image data captured by the camera, determines an orientation of the trailer relative to the vehicle.

### Claim 7 (depends on 6)

The vehicular trailer hitching assist system of claim 6, wherein the ECU determines the orientation of the trailer relative to the vehicle prior to determining the first path of travel.

### Claim 8 (depends on 1)

The vehicular trailer hitching assist system of claim 1, wherein the ECU, responsive to determining that the second path of travel is not followable, stops the vehicle.

### Claim 9 (depends on 1)

The vehicular trailer hitching assist system of claim 1, wherein the ECU, responsive to determining that the second path of travel is not followable, generates an alert to a driver of the vehicle.

### Claim 10 (depends on 1)

The vehicular trailer hitching assist system of claim 1, wherein the ECU, with the camera disposed at the rear portion of the vehicle, and via image processing by the image processor of image data captured by the camera, determines a position of the trailer hitch of the trailer, and wherein the determined position of the trailer hitch includes a height of the trailer hitch.

### Claim 11 (depends on 10)

The vehicular trailer hitching assist system of claim 10, wherein the ECU determines the position of the trailer hitch when the trailer hitch is less than a threshold distance from the vehicle.

### Claim 12 (depends on 1)

The vehicular trailer hitching assist system of claim 1, wherein the ECU is part of the camera.

### Claim 13 (depends on 1)

The vehicular trailer hitching assist system of claim 1, wherein the ECU is disposed at the vehicle separate from the rear portion of the vehicle where the camera is disposed.

### Claim 14 (depends on 1)

The vehicular trailer hitching assist system of claim 1, wherein the output of the ECU controls at least one vehicular function to maneuver the vehicle.

### Claim 15 (depends on 14)

The vehicular trailer hitching assist system of claim 14, wherein the at least one vehicular function is selected from the group consisting of (i) steering the vehicle and (ii) braking the vehicle.

### Claim 16 (depends on 15)

The vehicular trailer hitching assist system of claim 15, wherein the at least one vehicular function includes at least one selected from the group consisting of (i) accelerating the vehicle and (ii) shifting gears of the vehicle.

### Claim 17

A vehicular trailer hitching assist system, the vehicular trailer hitching assist system comprising:
a camera, wherein the camera is configured to be disposed at a rear portion of a vehicle so as to view at least rearward of the vehicle;
wherein the camera comprises an imaging array having at least one million photosensors arranged in rows and columns;
an electronic control unit (ECU) disposed at the vehicle, the ECU comprising an image processor operable to process image data captured by the camera with the camera disposed at the rear portion of the vehicle;
wherein, with the camera disposed at the rear portion of the vehicle, the ECU, via image processing by the image processor of image data captured by the camera, (i) detects a trailer that is present rearward of the vehicle, (ii) determines an orientation of the trailer relative to the vehicle and (iii) determines a first path of travel for the vehicle to follow to maneuver the vehicle toward the trailer and to align a tow ball of the vehicle with a trailer hitch of the trailer as the vehicle approaches the trailer;
wherein the ECU, responsive to determination of the first path of travel, generates an output to maneuver the vehicle along the determined first path of travel;
wherein, with the camera disposed at the rear portion of the vehicle and with the vehicle maneuvering along the determined first path of travel, the ECU, at least via image processing by the image processor of image data captured by the camera, detects an object entering the determined first path of travel;
wherein, with the camera disposed at the rear portion of the vehicle, and responsive to the detection of the object entering the determined first path of travel, the ECU, at least via image processing by the image processor of image data captured by the camera, determines a second path of travel for the vehicle to follow that avoids the detected object; and
wherein the ECU, responsive to determining that the second path of travel is not followable, one selected from the group consisting of (i) stops the vehicle, (ii) generates an alert to a driver of the vehicle, (iii) determines a third path of travel for the vehicle to follow to maneuver the vehicle toward the trailer and to align the tow ball of the vehicle with the trailer hitch of the trailer as the vehicle approaches the trailer.

### Claim 18 (depends on 17)

The vehicular trailer hitching assist system of claim 17, wherein the ECU, responsive to determination of the second path of travel, adjusts the output to maneuver the vehicle along the determined second path of travel and to avoid the detected object and to align the tow ball of the vehicle with the trailer hitch of the trailer as the vehicle approaches the trailer.

### Claim 19 (depends on 18)

The vehicular trailer hitching assist system of claim 18, wherein the ECU, responsive to determining that the second path of travel is not followable, one selected from the group consisting of (i) determines a third path of travel for the vehicle to follow and adjusts the output to maneuver the vehicle along the determined third path of travel to align the tow ball of the vehicle with the trailer hitch of the trailer as the vehicle approaches the trailer, and (ii) adjusts the output to maneuver the vehicle to resume following the determined first path of travel if the detected object has moved from the determined first path of travel.

### Claim 20 (depends on 17)

The vehicular trailer hitching assist system of claim 17, wherein the ECU determines the orientation of the trailer relative to the vehicle prior to determining the first path of travel.

### Claim 21 (depends on 17)

The vehicular trailer hitching assist system of claim 17, wherein the ECU, with the camera disposed at the rear portion of the vehicle, and via image processing by the image processor of image data captured by the camera, determines a position of the trailer hitch of the trailer, and wherein the determined position of the trailer hitch includes a height of the trailer hitch.

### Claim 22 (depends on 21)

The vehicular trailer hitching assist system of claim 21, wherein the ECU determines the position of the trailer hitch when the trailer hitch is less than a threshold distance from the vehicle.

### Claim 23

A vehicular trailer hitching assist system, the vehicular trailer hitching assist system comprising:
a camera, wherein the camera is configured to be disposed at a rear portion of a vehicle so as to view at least rearward of the vehicle;
wherein the camera comprises an imaging array having at least one million photosensors arranged in rows and columns;
an electronic control unit (ECU) disposed at the vehicle, the ECU comprising an image processor operable to process image data captured by the camera with the camera disposed at the rear portion of the vehicle;
wherein, with the camera disposed at the rear portion of the vehicle, the ECU, via image processing by the image processor of image data captured by the camera, (i) detects a trailer that is present rearward of the vehicle, (ii) determines an orientation of the trailer relative to the vehicle and (iii) determines a first path of travel for the vehicle to follow to maneuver the vehicle toward the trailer and to align a tow ball of the vehicle with a trailer hitch of the trailer as the vehicle approaches the trailer;
wherein the ECU, responsive to determination of the first path of travel, generates an output to control at least one vehicular function to maneuver the vehicle along the determined first path of travel;
wherein, with the camera disposed at the rear portion of the vehicle and with the vehicle maneuvering along the determined first path of travel, the ECU, at least via image processing by the image processor of image data captured by the camera, detects an object entering the determined first path of travel; and
wherein, with the camera disposed at the rear portion of the vehicle, and responsive to the detection of the object entering the determined first path of travel, the ECU, at least via image processing by the image processor of image data captured by the camera, determines a second path of travel for the vehicle to follow that avoids the detected object.

### Claim 24 (depends on 23)

The vehicular trailer hitching assist system of claim 23, wherein the ECU, responsive to determination of the second path of travel, adjusts the output to control the at least one vehicular function to maneuver the vehicle along the determined second path of travel and to avoid the detected object and to align the tow ball of the vehicle with the trailer hitch of the trailer as the vehicle approaches the trailer.

### Claim 25 (depends on 23)

The vehicular trailer hitching assist system of claim 23, wherein the ECU determines the orientation of the trailer relative to the vehicle prior to determining the first path of travel.

### Claim 26 (depends on 23)

The vehicular trailer hitching assist system of claim 23, wherein the ECU, responsive to determining that the second path of travel is not followable, stops the vehicle.

### Claim 27 (depends on 23)

The vehicular trailer hitching assist system of claim 23, wherein the ECU, responsive to determining that the second path of travel is not followable, generates an alert to a driver of the vehicle.

### Claim 28 (depends on 23)

The vehicular trailer hitching assist system of claim 23, wherein the at least one vehicular function is selected from the group consisting of (i) steering the vehicle and (ii) braking the vehicle.

### Claim 29 (depends on 28)

The vehicular trailer hitching assist system of claim 28, wherein the at least one vehicular function includes at least one selected from the group consisting of (i) accelerating the vehicle and (ii) shifting gears of the vehicle.
