# US 2024/0198909 A1 · System and method for enhancing occupant awareness

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2024/0198909 A1
- Document ID: US20240198909A1
- Status: Published application
- Kind: A1
- Application number: 18/066,458
- Filed: 2022-12-15
- Published: 2024-06-20
- Earliest claimed: 2022-12-15
- Assignees: GM Global Technology Operations LLC
- Applicants: GM Global Technology Operations LLC
- Inventors: Mohammad Naserian; Allan Kenneth Lewis; Apral Singh Hara
- Web page: https://patentgrep.com/patent/US20240198909A1

## CPC

- B60R 1/26: to the rear of the vehicle
- B60R 2300/8066: for monitoring rearward traffic
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR

## Abstract

A system for enhancing occupant awareness for a vehicle includes a camera system for capturing images of an environment surrounding the vehicle, a display for displaying information to the occupant of the vehicle and a controller in electrical communication with the camera system and the display. The controller is programmed to determine an activation state of the system. The controller is further programmed to capture an image of the environment surrounding the vehicle using the camera system in response to determining that the activation state is the activated state. The image has a first portion and a second portion. The first portion of the image includes a trailer connected to the vehicle and the second portion of the image. The controller is further programmed to display the second portion of the image to the occupant using the display based at least in part on the first portion of the image.

## Claims

### Claim 1

A system for enhancing occupant awareness for a vehicle, the system comprising:
a camera system for capturing images of an environment surrounding the vehicle;
a display for displaying information to the occupant of the vehicle;
a controller in electrical communication with the camera system and the display, wherein the controller is programmed to:
determine an activation state of the system, wherein the activation state includes an activated state and a deactivated state;
capture an image of the environment surrounding the vehicle using the camera system in response to determining that the activation state is the activated state, wherein the image has a first portion and a second portion, and wherein the first portion of the image includes a trailer connected to the vehicle and the second portion of the image; and
display the second portion of the image to the occupant using the display based at least in part on the first portion of the image.

### Claim 2 (depends on 1)

The system of claim 1, wherein to determine the activation state of the system, the controller is further programmed to:
determine a towing status of the vehicle, wherein the towing status includes a trailer connected status and a trailer disconnected status;
determine a transmission shift state of the vehicle, wherein the transmission shift state includes a forward shift state and a reverse shift state;
determine a trailer angle, wherein the trailer angle is an angle of the trailer relative to the vehicle; and
determine the activation state of the system to be the activated state in response to determining that the towing status is the trailer connected status, the transmission shift state is the reverse shift state, and the trailer angle is greater than or less than a predetermined trailer angle range.

### Claim 3 (depends on 2)

The system of claim 2, wherein to display the second portion of the image to the occupant using the display, the controller is further programmed to:
display the second portion of the image on a left-hand side of the display in response to determining that the trailer angle is less than one hundred and eighty; and
display the second portion of the image on a right-hand side of the display in response to determining that the trailer angle is greater than one hundred and eighty.

### Claim 4 (depends on 1)

The system of claim 1, wherein the first portion of the image includes an area of the environment behind the vehicle, and wherein the image includes a plurality of pixels, each of the plurality of pixels having an x-coordinate and a y-coordinate.

### Claim 5 (depends on 4)

The system of claim 4, wherein to display the second portion of the image to the occupant using the display, the controller is further programmed to:
identify a rear edge of the trailer based at least in part on the first portion of the image.

### Claim 6 (depends on 5)

The system of claim 5, wherein to identify the rear edge of the trailer, the controller is further programmed to:
detect a set of all edges of the trailer in the first portion of the image using an edge detection algorithm;
determine a set of outer edges of the trailer, wherein the set of outer edges is a subset of the set of all edges; and
identify a first set of pixels in the first portion of the image corresponding to the rear edge of the trailer, wherein the rear edge of the trailer is one edge of the set of outer edges, and wherein the first set of pixels includes an upper rear edge pixel and a lower rear edge pixel.

### Claim 7 (depends on 6)

The system of claim 6, wherein the second portion of the image is adjacent to the rear edge of the trailer, and wherein a predetermined trailer area of the second portion of the image includes the trailer.

### Claim 8 (depends on 7)

The system of claim 7, wherein the predetermined trailer area is fifteen percent of a total area of the second portion of the image.

### Claim 9 (depends on 7)

The system of claim 7, wherein the second portion of the image is a rectangle defined by a plurality of corner pixels within the first portion of the image, and wherein to display the second portion of the image to the occupant using the display, the controller is further programmed to:
determine the x-coordinate and the y-coordinate of a first of the plurality of corner pixels, wherein the x-coordinate of the first corner pixel is based at least in part on the x-coordinate of the upper rear edge pixel and the predetermined trailer area, and wherein the y-coordinate of the first corner pixel is greater than or equal to the y-coordinate of the upper rear edge pixel; and
determine the x-coordinate and the y-coordinate of a second of the plurality of corner pixels, wherein the x-coordinate of the second corner pixel is based at least in part on the x-coordinate of the lower rear edge pixel and the predetermined trailer area, and wherein the y-coordinate of the second corner pixel is less than or equal to the y-coordinate of the lower rear edge pixel.

### Claim 10 (depends on 9)

The system of claim 9, wherein to display the second portion of the image to the occupant using the display, the controller is further programmed to:
determine the x-coordinate and the y-coordinate of a third of the plurality of corner pixels, wherein the x-coordinate and the y-coordinate of the third corner pixel is based at least in part on an aspect ratio of the display; and
determine the x-coordinate and the y-coordinate of a fourth of the plurality of corner pixels, wherein the x-coordinate and the y-coordinate of the fourth corner pixel is based at least in part on an aspect ratio of the display.

### Claim 11

A method for enhancing occupant awareness for a vehicle, the method comprising:
capturing an image of an environment surrounding the vehicle using a camera system, wherein the image has a first portion and a second portion, and wherein the first portion of the image includes a trailer connected to the vehicle and the second portion of the image; and
displaying the second portion of the image to the occupant using a display based at least in part on the first portion of the image.

### Claim 12 (depends on 11)

The method of claim 11, wherein the first portion of the image includes an area of the environment behind the vehicle, and wherein the first portion of the image includes a plurality of pixels, each of the plurality of pixels having an x-coordinate and a y-coordinate.

### Claim 13 (depends on 12)

The method of claim 12, wherein displaying the second portion of the image to the occupant using the display further comprises:
identifying a rear edge of the trailer based at least in part on the first portion of the image

### Claim 14 (depends on 13)

The method of claim 13, wherein identifying the rear edge of the trailer further comprises:
detecting a set of all edges of the trailer in the first portion of the image using an edge detection algorithm;
determining a set of outer edges of the trailer, wherein the set of outer edges is a subset of the set of all edges; and
identifying a first set of pixels in the first portion of the image corresponding to the rear edge of the trailer, wherein the rear edge of the trailer is one edge of the set of outer edges, and wherein the first set of pixels includes an upper rear edge pixel and a lower rear edge pixel.

### Claim 15 (depends on 14)

The method of claim 14, wherein the second portion of the image is adjacent to the rear edge of the trailer, wherein a predetermined trailer area of the second portion of the image includes the trailer, and wherein the predetermined trailer area is fifteen percent of a total area of the second portion of the image.

### Claim 16 (depends on 15)

The method of claim 15, wherein the second portion of the image is a rectangle defined by a plurality of corner pixels within the first portion of the image, and wherein displaying the second portion of the image to the occupant using the display further comprises:
determining the x-coordinate and the y-coordinate of a first of the plurality of corner pixels, wherein the x-coordinate of the first corner pixel is based at least in part on the x-coordinate of the upper rear edge pixel and the predetermined trailer area, and wherein the y-coordinate of the first corner pixel is greater than or equal to the y-coordinate of the upper rear edge pixel; and
determining the x-coordinate and the y-coordinate of a second of the plurality of corner pixels, wherein the x-coordinate of the second corner pixel is based at least in part on the x-coordinate of the lower rear edge pixel and the predetermined trailer area, and wherein the y-coordinate of the second corner pixel is less than or equal to the y-coordinate of the lower rear edge pixel.

### Claim 17 (depends on 16)

The method of claim 16, wherein displaying the second portion of the image to the occupant using the display further comprises:
determining the x-coordinate and the y-coordinate of a third of the plurality of corner pixels, wherein the x-coordinate and the y-coordinate of the third corner pixel is based at least in part on an aspect ratio of the display; and
determining the x-coordinate and the y-coordinate of a fourth of the plurality of corner pixels, wherein the x-coordinate and the y-coordinate of the fourth corner pixel is based at least in part on an aspect ratio of the display.

### Claim 18

A system for enhancing occupant awareness for a vehicle, the system comprising:
a camera system for capturing images of an environment surrounding the vehicle;
a display for displaying information to an occupant of the vehicle;
a controller in electrical communication with the camera system and the display, wherein the controller is programmed to:
determine a towing status of the vehicle, wherein the towing status includes a trailer connected status and a trailer disconnected status;
determine a transmission shift state of the vehicle, wherein the transmission shift state includes a forward shift state and a reverse shift state;
determine a trailer angle, wherein the trailer angle is an angle of the trailer relative to the vehicle;
capture an image of the environment surrounding the vehicle using the camera system in response to determining that the towing status is the trailer connected status, the transmission shift state is the reverse shift state, and a magnitude of the trailer angle is greater than or less than a predetermined trailer angle range, wherein the image has a first portion and a second portion, and
wherein the first portion of the image includes a trailer connected to the vehicle and the second portion of the image, and wherein the image includes a plurality of pixels, each of the plurality of pixels having an x-coordinate and a y-coordinate;
identify a rear edge of the trailer based at least in part on the first portion of the image;
display the second portion of the image to the occupant using the display based at least in part on the rear edge of the trailer in the first portion of the image.

### Claim 19 (depends on 18)

The system of claim 18, wherein to identify the rear edge of the trailer, the controller is further programmed to:
detect a set of all edges of the trailer in the first portion of the image using an edge detection algorithm;
determine a set of outer edges of the trailer, wherein the set of outer edges is a subset of the set of all edges; and
identify a first set of pixels in the first portion of the image corresponding to the rear edge of the trailer, wherein the rear edge of the trailer is one edge of the set of outer edges, and wherein the first set of pixels includes an upper rear edge pixel and a lower rear edge pixel.

### Claim 20 (depends on 19)

The system of claim 19, wherein the second portion of the image is a rectangle defined by a plurality of corner pixels within the first portion of the image, and wherein to display the second portion of the image to the occupant using the display, the controller is further programmed to:
determine the x-coordinate and the y-coordinate of a first of the plurality of corner pixels, wherein the x-coordinate of the first corner pixel is based at least in part on the x-coordinate of the upper rear edge pixel and the predetermined trailer area, and wherein the y-coordinate of the first corner pixel is greater than or equal to the y-coordinate of the upper rear edge pixel;
determine the x-coordinate and the y-coordinate of a second of the plurality of corner pixels, wherein the x-coordinate of the second corner pixel is based at least in part on the x-coordinate of the lower rear edge pixel and the predetermined trailer area, and wherein the y-coordinate of the second corner pixel is less than or equal to the y-coordinate of the lower rear edge pixel;
determine the x-coordinate and the y-coordinate of a third of the plurality of corner pixels, wherein the x-coordinate and the y-coordinate of the third corner pixel is based at least in part on an aspect ratio of the display; and
determine the x-coordinate and the y-coordinate of a fourth of the plurality of corner pixels, wherein the x-coordinate and the y-coordinate of the fourth corner pixel is based at least in part on an aspect ratio of the display.
