# US 2021/0078634 A1 · Vehicular trailering assist system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2021/0078634 A1
- Document ID: US20210078634A1
- Status: Published application
- Kind: A1
- Application number: 16/948,253
- Filed: 2020-09-10
- Published: 2021-03-18
- Earliest claimed: 2019-09-13
- Assignees: Magna Electronics Inc.
- Applicants: Magna Electronics Inc.
- Inventors: Mohammadmehdi Jalalmaab; Jyothi P. Gali; Devendra Bajpai; Alexander Velichko
- Web page: https://patentgrep.com/patent/US20210078634A1

## CPC

- B62D 15/0285: {Parking performed automatically}
- B60R 1/003: {for viewing trailer hitches}
- B62D 13/06: for backing a normally drawn trailer
- G05D 1/0212: {with means for defining a desired trajectory (involving a plurality of land vehicles G05D1/0287)}
- G05D 1/0246: {using a video camera in combination with image processing means}
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- H04N 23/54: Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
- B60R 2300/10: characterised by the type of camera system used
- B60R 2300/30: characterised by the type of image processing
- B60R 2300/806: for aiding parking
- G06T 2207/30241: Trajectory
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- B62D: MOTOR VEHICLES; TRAILERS (steering, or guiding on a desired track, of agricultural machines or implements A01B69/00; wheels, castors, axles, increasing wheel adhesion B60B; vehicle tyres, tyre inflation or tyre changing B60C; connections between vehicles of a train or the like B60D; vehicles for use on rail and road, amphibious or convertible vehicles B60F; suspension arrangements B60G; heating, cooling, ventilating or other air treating devices B60H; windows, windscreens, non-fixed roofs, doors or similar devices, protective coverings for vehicles not in use B60J; propulsion plant arrangements, auxiliary drives, transmissions, controls, instrumentation or dashboards B60K; electric equipment or propulsion of electrically-propelled vehicles B60L; power supply for electrically-propelled vehicles B60M; passenger accommodation not otherwise provided for B60N; adaptations for load transportation or to carry special loads or objects B60P; arrangement of signalling or lighting devices, the mounting or supporting thereof or circuits therefor, for vehicles in general B60Q; vehicles, vehicle fittings or vehicle parts not otherwise provided for B60R; servicing, cleaning, repairing, supporting, lifting, or manoeuvring, not otherwise provided for, B60S; brake arrangements, brake control systems or parts thereof B60T; air-cushion vehicles B60V; motor-cycles, accessories therefor B62J, B62K; testing of vehicles G01M)
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A vehicular trailering assist system includes a rearward viewing camera at a vehicle and an electronic control unit (ECU). During a reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched to the vehicle, the ECU (i) determines a target trajectory for the trailer, (ii) determines a lateral path deviation of the trailer that represents a deviation of a current trajectory of the trailer from the target trajectory for the trailer, (iii) determines a trailer heading angle correction, and (iv) determines a target trailer angle of the trailer relative to the vehicle based on the current trailer angle of the trailer and the trailer heading angle correction. Responsive to determination of the target trailer angle of the trailer, the ECU controls steering of the vehicle to achieve the target trailer angle and direct the vehicle and the trailer towards the target trajectory.

## Claims

### Claim 1

A vehicular trailering assist system, the vehicular trailering assist system comprising:
a camera disposed at a rear portion of a vehicle and viewing at least rearward of the vehicle, wherein, with a trailer hitched at a trailer hitch of the vehicle, the camera views at least a portion of the trailer hitched at the trailer hitch of the vehicle;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein the electronic circuitry comprises an image processor operable to process image data captured by the camera, and wherein, with the trailer hitched at the trailer hitch of the vehicle, image data captured by the camera includes image data of the portion of the trailer hitched at the trailer hitch of the vehicle;
wherein the ECU, responsive to processing at the ECU of image data captured by the camera, and during a reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, determines a target trajectory for the trailer;
wherein the ECU, responsive to determining the target trajectory for the trailer, determines a lateral path deviation of the trailer, and wherein the lateral path deviation of the trailer represents a deviation of a current trajectory of the trailer from the target trajectory for the trailer;
wherein the ECU, responsive to determining the lateral path deviation of the trailer, determines a trailer heading angle correction;
wherein the ECU, responsive to determining the trailer heading angle correction, and based on a current trailer angle of the trailer and the trailer heading angle correction, determines a target trailer angle of the trailer relative to the vehicle that, when achieved, will direct the trailer toward the target trajectory for the trailer; and
wherein, responsive to determination by the ECU of the target trailer angle of the trailer, and during the reversing maneuver of the vehicle and trailer, the ECU controls steering of the vehicle to achieve the target trailer angle and direct the vehicle and the trailer towards the target trajectory for the trailer.

### Claim 2 (depends on 1)

The vehicular trailering assist system of claim 1, wherein the ECU, responsive to determining the target trailer angle, determines, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, a stability of the target trailer angle.

### Claim 3 (depends on 2)

The vehicular trailering assist system of claim 2, wherein the ECU determines whether the target trailer angle is globally asymptotic stable.

### Claim 4 (depends on 2)

The vehicular trailering assist system of claim 2, wherein the ECU uses a candidate-Lyapunov-function to determine the stability of the target trailer angle.

### Claim 5 (depends on 1)

The vehicular trailering assist system of claim 1, wherein, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, the ECU determines kinematics of the current heading of the trailer.

### Claim 6 (depends on 1)

The vehicular trailering assist system of claim 1, wherein, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, the ECU determines kinematics of the current trailer angle of the trailer relative to the vehicle.

### Claim 7 (depends on 1)

The vehicular trailering assist system of claim 1, wherein the ECU utilizes a feedback linearization technique for nonlinear systems to control steering of the vehicle.

### Claim 8 (depends on 1)

The vehicular trailering assist system of claim 1, wherein the ECU determines the target trajectory for the trailer responsive to actuation of a user input.

### Claim 9 (depends on 1)

The vehicular trailering assist system of claim 1, wherein, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, the current trajectory of the trailer is determined via a kinematic model observer.

### Claim 10 (depends on 1)

The vehicular trailering assist system of claim 1, wherein, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, the ECU determines the trailer heading angle correction based at least in part on an estimated trailer heading determined via a kinematic model observer.

### Claim 11

A vehicular trailering assist system, the vehicular trailering assist system comprising:
a camera disposed at a rear portion of a vehicle and viewing at least rearward of the vehicle, wherein, with a trailer hitched at a trailer hitch of the vehicle, the camera views at least a portion of the trailer hitched at the trailer hitch of the vehicle;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein the electronic circuitry comprises an image processor operable to process image data captured by the camera, and wherein, with the trailer hitched at the trailer hitch of the vehicle, image data captured by the camera includes image data of the portion of the trailer hitched at the trailer hitch of the vehicle;
wherein the ECU, responsive to processing at the ECU of image data captured by the camera, and during a reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, determines a target trajectory for the trailer;
wherein the ECU, responsive to determining the target trajectory for the trailer, determines a lateral path deviation of the trailer, and wherein the lateral path deviation of the trailer represents a deviation of a current trajectory of the trailer from the target trajectory for the trailer;
wherein the ECU, responsive to determining the lateral path deviation of the trailer, determines a trailer heading angle correction;
wherein the ECU, responsive to determining the trailer heading angle correction, and based on a current trailer angle of the trailer and the trailer heading angle correction, determines a target trailer angle of the trailer relative to the vehicle that, when achieved, will direct the trailer toward the target trajectory for the trailer;
wherein the ECU, responsive to determining the target trailer angle, determines, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, a stability of the target trailer angle using a candidate-Lyapunov-function;
wherein the ECU determines whether the target trailer angle is globally asymptotic stable; and
wherein, responsive to determination by the ECU of the target trailer angle of the trailer and determination by the ECU that the target trailer angle is globally asymptotic stable, and during the reversing maneuver of the vehicle and trailer, the ECU controls steering of the vehicle to achieve the target trailer angle and direct the vehicle and the trailer towards the target trajectory for the trailer.

### Claim 12 (depends on 11)

The vehicular trailering assist system of claim 11, wherein, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, the ECU determines kinematics of the current heading of the trailer.

### Claim 13 (depends on 11)

The vehicular trailering assist system of claim 11, wherein, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, the ECU determines kinematics of the current trailer angle of the trailer relative to the vehicle.

### Claim 14 (depends on 11)

The vehicular trailering assist system of claim 11, wherein the ECU utilizes a feedback linearization technique for nonlinear systems to control steering of the vehicle.

### Claim 15 (depends on 11)

The vehicular trailering assist system of claim 11, wherein the ECU determines the target trajectory for the trailer responsive to actuation of a user input.

### Claim 16 (depends on 11)

The vehicular trailering assist system of claim 11, wherein, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, the current trajectory of the trailer is determined via a kinematic model observer.

### Claim 17

A vehicular trailering assist system, the vehicular trailering assist system comprising:
a camera disposed at a rear portion of a vehicle and viewing at least rearward of the vehicle, wherein, with a trailer hitched at a trailer hitch of the vehicle, the camera views at least a portion of the trailer hitched at the trailer hitch of the vehicle;
an electronic control unit (ECU) comprising electronic circuitry and associated software;
wherein the electronic circuitry comprises an image processor operable to process image data captured by the camera, and wherein, with the trailer hitched at the trailer hitch of the vehicle, image data captured by the camera includes image data of the portion of the trailer hitched at the trailer hitch of the vehicle;
wherein the ECU, responsive to processing at the ECU of image data captured by the camera, and during a reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, determines a target trajectory for the trailer;
wherein the ECU, responsive to determining the target trajectory for the trailer, determines a lateral path deviation of the trailer, and wherein the lateral path deviation of the trailer represents a deviation of a current trajectory of the trailer from the target trajectory for the trailer;
wherein the ECU, responsive to determining the lateral path deviation of the trailer, determines a trailer heading angle correction;
wherein the ECU, responsive to determining the trailer heading angle correction, and based on a current trailer angle of the trailer and the trailer heading angle correction, determines a target trailer angle of the trailer relative to the vehicle that, when achieved, will direct the trailer toward the target trajectory for the trailer;
wherein, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, the ECU determines kinematics of the current heading of the trailer and kinematics of the current trailer angle of the trailer relative to the vehicle; and
wherein, responsive to determination by the ECU of the target trailer angle of the trailer and determination by the ECU of the kinematics of the current heading of the trailer and the kinematics of the current trailer angle of the trailer relative to the vehicle, and during the reversing maneuver of the vehicle and trailer, the ECU controls steering of the vehicle to achieve the target trailer angle and direct the vehicle and the trailer towards the target trajectory for the trailer.

### Claim 18 (depends on 17)

The vehicular trailering assist system of claim 17, wherein the ECU utilizes a feedback linearization technique for nonlinear systems to control steering of the vehicle.

### Claim 19 (depends on 17)

The vehicular trailering assist system of claim 17, wherein the ECU determines the target trajectory for the trailer responsive to actuation of a user input.

### Claim 20 (depends on 17)

The vehicular trailering assist system of claim 17, wherein, during the reversing maneuver of the vehicle and trailer while the vehicle is in motion and the trailer is hitched at the trailer hitch of the vehicle, the ECU determines the trailer heading angle correction based at least in part on an estimated trailer heading determined via a kinematic model observer.
