# US 2017/0374340 A1 · Vehicle vision system with customized display

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0374340 A1
- Document ID: US20170374340A1
- Status: Published application
- Kind: A1
- Application number: 15/700,274
- Filed: 2017-09-11
- Published: 2017-12-28
- Earliest claimed: 2011-12-09
- Assignees: Magna Electronics Inc.
- Applicants: Magna Electronics Inc.
- Inventors: Goerg Pflug
- Web page: https://patentgrep.com/patent/US20170374340A1

## CPC

- H04N 13/106: Processing image signals (for multi-view video sequence encoding H04N19/597)
- G06T 7/80: Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
- G06T 15/00: Three-dimensional [3D] image rendering
- G06T 15/20: Perspective computation
- G06T 15/50: Lighting effects
- H04N 13/15: for colour aspects of image signals
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T 2207/30264: Parking
- G06T 2210/62: Semi-transparency
- G06T 2215/16: Using real world measurements to influence rendering
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

A vision system for a vehicle includes a plurality of cameras and a processor operable to process image data captured by the cameras to generate images derived from image data captured by at least some of the cameras. The processor is operable to generate a three dimensional vehicle representation. A display screen, viewable by a driver of the vehicle, is operable to display the generated images and the three dimensional vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the vehicle itself. A portion of the three dimensional vehicle representation is rendered as displayed to be at least partially transparent to enable viewing at the display screen of an object present exterior of the vehicle that would otherwise be partially hidden by non-transparent display of that portion of the three dimensional vehicle representation.

## Claims

### Claim 1

A vision system for a vehicle, said vision system comprising:
a plurality of cameras disposed at a vehicle equipped with said vision system, wherein said plurality of cameras comprises a front camera having a field of view forward of the equipped vehicle, a rear camera having a field of view rearward of the equipped vehicle, a driver side camera having a field of view sideward of the equipped vehicle, and a passenger side camera having a field of view sideward of the equipped vehicle;
a processor operable to process image data captured by said plurality of cameras;
wherein said processor processes image data captured by at least some of said front camera, said rear camera, said driver side camera and said passenger side camera to generate images derived from image data captured by the at least some of said front camera, said rear camera, said driver side camera and said passenger side camera;
wherein said processor is operable to generate a three dimensional vehicle representation;
a display screen viewable by a driver of the equipped vehicle, wherein said display screen is operable to display the generated images and to display the three dimensional vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the equipped vehicle itself;
wherein the displayed images are representative of an environment at least partially surrounding the equipped vehicle; and
wherein a portion of the three dimensional vehicle representation is rendered as displayed to be at least partially transparent to enable viewing at said display screen of an object present exterior of the equipped vehicle that would otherwise be partially hidden by non-transparent display of that portion of the three dimensional vehicle representation.

### Claim 2 (depends on 1)

The vision system of claim 1, wherein the three dimensional vehicle representation comprises one of (i) a vehicle representation having a body style corresponding to that of the equipped vehicle and (ii) a vehicle representation having a color corresponding to that of the equipped vehicle.

### Claim 3 (depends on 1)

The vision system of claim 1, wherein, responsive at least in part to processing of image data captured by at least one of said plurality of cameras, said vision system determines the body type of the equipped vehicle and at least one of (i) a body style of the equipped vehicle and (ii) a color of the equipped vehicle.

### Claim 4 (depends on 1)

The vision system of claim 1, wherein, responsive at least in part to a selection input, said vision system determines the body type of the equipped vehicle and at least one of (i) a body style of the equipped vehicle and (ii) a color of the equipped vehicle.

### Claim 5 (depends on 1)

The vision system of claim 1, wherein said vision system is operable to adjust a degree of transparency of the at least partially transparent portion of the three dimensional vehicle representation.

### Claim 6 (depends on 5)

The vision system of claim 5, wherein the degree of transparency of the three dimensional vehicle representation is adjusted responsive to a distance from the equipped vehicle to the virtual camera viewpoint.

### Claim 7 (depends on 5)

The vision system of claim 5, wherein the degree of transparency of the three dimensional vehicle representation is adjusted responsive to an aberration angle of the equipped vehicle from the viewing direction of the virtual camera viewpoint.

### Claim 8 (depends on 1)

The vision system of claim 1, wherein the three dimensional vehicle representation comprises an overlay that is applied to the displayed images.

### Claim 9 (depends on 8)

The vision system of claim 8, wherein a noise level of said overlay is adapted to generally match a noise level in said image data captured by said plurality of cameras.

### Claim 10 (depends on 8)

The vision system of claim 8, wherein a blurring level of said overlay is adapted to the speed of the overlay relative to the displayed images.

### Claim 11 (depends on 1)

The vision system of claim 1, wherein the displayed images are enhanced by an artificial blooming effect around light sources meant to appear bright.

### Claim 12 (depends on 1)

The vision system of claim 1, wherein the displayed images are enhanced by having artificial lens flare overlays.

### Claim 13 (depends on 1)

The vision system of claim 1, wherein a stitching borderline between images derived from image data captured by two of said plurality of cameras is adjusted dynamically according to structure appearing in image data captured by said two of said plurality of cameras.

### Claim 14 (depends on 1)

The vision system of claim 1, wherein the field of view of at least some of said plurality of cameras encompasses a portion of the equipped vehicle, and wherein captured image data of the portion of the equipped vehicle is transferred into a three dimensional vehicle representation as seen from the virtual camera viewpoint.

### Claim 15 (depends on 1)

The vision system of claim 1, wherein the three dimensional vehicle representation is generated responsive at least in part to input representative of the body type and body style and color of the equipped vehicle.

### Claim 16

A vision system for a vehicle, said vision system comprising:
a plurality of cameras disposed at a vehicle equipped with said vision system, wherein said plurality of cameras comprises a front camera having a field of view forward of the equipped vehicle, a rear camera having a field of view rearward of the equipped vehicle, a driver side camera having a field of view sideward of the equipped vehicle, and a passenger side camera having a field of view sideward of the equipped vehicle;
a processor operable to process image data captured by said plurality of cameras;
wherein said processor processes image data captured by at least some of said front camera, said rear camera, said driver side camera and said passenger side camera to generate images derived from image data captured by the at least some of said front camera, said rear camera, said driver side camera and said passenger side camera;
wherein said processor is operable to generate a three dimensional vehicle representation;
a display screen viewable by a driver of the equipped vehicle, wherein said display screen is operable to display the generated images and to display the three dimensional vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the equipped vehicle itself;
wherein the three dimensional vehicle representation comprises an overlay that is applied to the displayed images;
wherein the displayed images are representative of an environment at least partially surrounding the equipped vehicle;
wherein a portion of the three dimensional vehicle representation is rendered as displayed to be at least partially transparent to enable viewing at said display screen of an object present exterior of the equipped vehicle that would otherwise be partially hidden by non-transparent display of that portion of the three dimensional vehicle representation; and
wherein said vision system is operable to adjust a degree of transparency of the at least partially transparent portion of the three dimensional vehicle representation.

### Claim 17 (depends on 16)

The vision system of claim 16, wherein the degree of transparency of the three dimensional vehicle representation is adjusted responsive to a distance from the equipped vehicle to the virtual camera viewpoint.

### Claim 18 (depends on 16)

The vision system of claim 16, wherein the degree of transparency of the three dimensional vehicle representation is adjusted responsive to an aberration angle of the equipped vehicle from the viewing direction of the virtual camera viewpoint.

### Claim 19

A vision system for a vehicle, said vision system comprising:
a plurality of cameras disposed at a vehicle equipped with said vision system, wherein said plurality of cameras comprises a front camera having a field of view forward of the equipped vehicle, a rear camera having a field of view rearward of the equipped vehicle, a driver side camera having a field of view sideward of the equipped vehicle, and a passenger side camera having a field of view sideward of the equipped vehicle;
a processor operable to process image data captured by said plurality of cameras;
wherein said processor processes image data captured by at least some of said front camera, said rear camera, said driver side camera and said passenger side camera to generate images derived from image data captured by the at least some of said front camera, said rear camera, said driver side camera and said passenger side camera;
wherein said processor is operable to generate a three dimensional vehicle representation;
a display screen viewable by a driver of the equipped vehicle, wherein said display screen is operable to display the generated images and to display the three dimensional vehicle representation as would be viewed from a virtual camera viewpoint exterior to and higher than the equipped vehicle itself;
wherein the displayed images are representative of an environment at least partially surrounding the equipped vehicle;
wherein a portion of the three dimensional vehicle representation is rendered as displayed to be at least partially transparent to enable viewing at said display screen of an object present exterior of the equipped vehicle that would otherwise be partially hidden by non-transparent display of that portion of the three dimensional vehicle representation;
wherein the field of view of at least some of said plurality of cameras encompasses a portion of the equipped vehicle, and wherein captured image data of the portion of the equipped vehicle is transferred into a three dimensional vehicle representation as seen from the virtual camera viewpoint; and
wherein the three dimensional vehicle representation is representative of at least one of body type of the equipped vehicle, body style of the equipped vehicle and color of the equipped vehicle.

### Claim 20 (depends on 19)

The vision system of claim 19, wherein the three dimensional vehicle representation comprises an overlay that is applied to the displayed images.
