# US 2018/0022278 A1 · System and method for enhancing vehicle environment perception

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2018/0022278 A1
- Document ID: US20180022278A1
- Status: Published application
- Kind: A1
- Application number: 15/213,440
- Filed: 2016-07-19
- Published: 2018-01-25
- Earliest claimed: 2016-07-19
- Assignees: GM Global Technology Operations LLC
- Applicants: GM Global Technology Operations LLC
- Inventors: Shreyas G. Parat
- Web page: https://patentgrep.com/patent/US20180022278A1

## CPC

- B60R 1/002: {specially adapted for covering the peripheral part of the vehicle, e.g. for viewing tyres, bumpers or the like (integrated in the windows B60R1/001; combined with rear-view mirrors B60R1/08)}
- B60R 1/12: Mirror assemblies combined with other articles, e.g. clocks
- B60R 11/04: Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
- H04N 23/51: Housings
- H04N 23/63: by using electronic viewfinders
- B60R 2001/1253: {with cameras, video cameras or video screens}
- B60R 2011/004: {outside the vehicle}
- B60R 2300/105: using multiple cameras
- B60R 2300/8026: in addition to a rear-view mirror system
- B60R 2300/806: for aiding parking
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A system method to enhance vehicle-environment perception are provided. The system includes a memory comprising one or more executable instructions, a controller configured to read and execute the one or more executable instructions, a camera configured to view or capture or view and capture an image of a selected portion of the vehicle environment, a display configured to exhibit information, a user input configured to allow one or more commands to be provided to the system. The executable instructions moreover enable the controller to operate the camera based on the one or more commands, retrieve information of the selected portion of the vehicle environment, generate perception information from the retrieved information, and exhibit the perception information.

## Claims

### Claim 1

A system to enhance vehicle-environment perception, the system comprising:
a memory comprising one or more executable instructions;
a controller configured to read and execute the one or more executable instructions;
a camera configured to view or capture or view and capture an image of a selected portion of the vehicle environment;
a display configured to exhibit information;
a user input configured to allow one or more commands to be provided to the system; and
wherein the executable instructions enable the controller to:
operate the camera based on the one or more commands;
retrieve, from the camera, information of the selected portion of the vehicle environment;
generate perception information from the retrieved information of the selected portion of the vehicle environment; and
exhibit, through the display, the perception information.

### Claim 2 (depends on 1)

The system of claim 1, further comprising:
a sensor configured to determine when the vehicle encounters a road surface feature and send a corresponding sensor signal to the controller; and
wherein the executable instructions enable the controller to retrieve the sensor signal and activate the camera to view or capture or view and capture an image of the selected portion of the vehicle environment.

### Claim 3 (depends on 2)

The system of claim 2, further comprising:
a communication device configured to signally communicate with a remote party; and
wherein the executable instructions enable the controller to retrieve the sensor signal and, via the communication device, send an output signal to the remote party.

### Claim 4 (depends on 2)

The system of claim 2, wherein the road surface feature encountered by the vehicle is a pothole, speed bump, curb, racetrack finish line, road lane indicators, mud pits, water puddles, or a wet surface.

### Claim 5 (depends on 1)

The system of claim 1, wherein:
the camera is positioned at the side-view mirror assembly of the vehicle; and
the display is configured to exhibit the perception information at the side-view mirror assembly.

### Claim 6 (depends on 1)

The system of claim 1, wherein:
the camera is positioned at the side-view mirror assembly of the vehicle; and
the display is configured to exhibit the perception information at the console screen of the vehicle infotainment unit.

### Claim 7 (depends on 1)

The system of claim 1, wherein the selected portion of the vehicle environment substantially comprises the location at which a front tire and its respective underlying surface meet.

### Claim 8 (depends on 1)

The system of claim 1, wherein executable instructions further enable the controller to record and store the perception information to the memory.

### Claim 9

A system to enhance vehicle-environment perception, the system comprising:
a memory comprising one or more executable instructions;
a controller configured to read and execute the one or more executable instructions;
a plurality of cameras configured to view or capture or view and capture images of selected portions of the vehicle environment;
a display configured to exhibit information;
a user input configured to allow one or more commands to be provided to the system; and
wherein the executable instructions enable the controller to:
operate the plurality of cameras based on the one or more commands;
retrieve, from the plurality of cameras, information of the selected portions of the vehicle environment;
generate perception information from the retrieved information of the selected portions of the vehicle environment; and
exhibit, through the display, the perception information from at least one of the cameras.

### Claim 11 (depends on 9)

The system of claim 9, further comprising:
a sensor configured to determine when the vehicle encounters a road surface feature and send a corresponding sensor signal to the controller; and
wherein the executable instructions enable the controller to retrieve the sensor signal and activate at least one of the cameras to view or capture or view and capture at least one image from the selected portions of the vehicle environment.

### Claim 12 (depends on 10)

The system of claim 10, further comprising:
a communication device configured to signally communicate with a remote party; and
wherein the executable instructions enable the controller to retrieve the sensor signal and, via the communication device, send an output signal to the remote party.

### Claim 13 (depends on 10)

The system of claim 10, wherein the road surface feature encountered by the vehicle is a pothole, speed bump, curb, racetrack finish line, road lane indicators, mud pits, water puddles, or a wet surface.

### Claim 14 (depends on 9)

The system of claim 9, further comprising:
an additional display configured to exhibit additional information; and
wherein the plurality of cameras are positioned at first and second side-view mirror assemblies of the vehicle, and wherein the display is configured to exhibit the perception information at the first side-view mirror assembly and the additional display is configured to exhibit additional perception information at the second side-view mirror assembly.

### Claim 15 (depends on 9)

The system of claim 9, wherein:
the plurality of cameras are positioned at first and second side-view mirror assemblies of the vehicle; and
the display is configured to exhibit the perception information at the console screen of the vehicle infotainment unit.

### Claim 16 (depends on 9)

The system of claim 9, wherein the selected portions of the vehicle environment substantially comprises the locations where each front tire and its respective underlying surface meet.

### Claim 17 (depends on 9)

The system of claim 9, wherein executable instructions further enable the controller to record and store the perception information to the memory.

### Claim 18

A method to enhance vehicle-environment perception, the method comprising:
providing a camera positioned at the side-view mirror assembly of a vehicle, the camera configured to view or capture or view and capture an image of the location at which a front tire and its respective underlying surface meet;
providing a display configured to exhibit information;
providing a user input configured to allow one or more commands to be provided to the camera;
commanding operation of the camera, via the user input;
viewing or capturing or viewing and capturing, via the camera, an image of the selected portion of a vehicle environment;
retrieving from the camera, via the controller, information of the selected portion of the vehicle environment;
generating perception information, via the controller, from the retrieved information of the selected portions of the vehicle environment; and
exhibiting, via the display, the perception information.

### Claim 19 (depends on 18)

The method of claim 18, wherein the display is configured to exhibit the perception information at the side-view mirror assembly.

### Claim 20 (depends on 18)

The method of claim 18, wherein the display is configured to exhibit the perception information at the console screen of the vehicle infotainment unit.
