# US 2019/0379841 A1 · Apparatus and method for displaying information

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2019/0379841 A1
- Document ID: US20190379841A1
- Status: Published application
- Kind: A1
- Application number: 16/486,267
- Filed: 2018-01-29
- Published: 2019-12-12
- Earliest claimed: 2017-02-16
- Assignees: Jaguar Land Rover Limited
- Applicants: Jaguar Land Rover Limited
- Inventors: Robert Hardy; Philip Thomas; David Wilson; Martin Edney
- Web page: https://patentgrep.com/patent/US20190379841A1

## CPC

- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- H04N 5/265: Mixing
- B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
- B60K 35/22: Display screens
- B60K 35/23: Head-up displays [HUD] (optical aspects of head-up displays G02B27/01)
- B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
- B60K 35/50: Instruments characterised by their means of attachment to or integration in the vehicle (B60K35/231 takes precedence)
- B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10)
- B60K 35/80: Arrangements for controlling instruments
- B60K 35/90: Calibration of instruments, e.g. setting initial or reference parameters; Testing of instruments, e.g. detecting malfunction
- B60R 1/23: with a predetermined field of view
- G06T 5/50: using two or more images, e.g. averaging or subtraction
- G06T 5/77: Retouching; Inpainting; Scratch removal
- G06T 7/70: Determining position or orientation of objects or cameras (camera calibration G06T7/80)
- G06T 11/00: Two-dimensional [2D] image generation
- B60K 2360/167: Vehicle dynamics information
- B60R 2300/105: using multiple cameras
- B60R 2300/303: using joined images, e.g. multiple camera images
- B60R 2300/304: using merged images, e.g. merging camera image with stored images
- B60R 2300/307: virtually distinguishing relevant parts of a scene from the background of the scene
- G06T 2207/10016: Video; Image sequence
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T 2207/30261: Obstacle
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES
- B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR

## Abstract

Embodiments of the present invention provide display method for use in a vehicle, the method comprising: obtaining (600) images of a region external to the vehicle; storing (608) at least a portion of the obtained images; generating (614) a composite image from a current image and a stored image by matching (612) portions of the stored image and the current image; and displaying (616) at least part of the composite image; wherein the composite image comprises a first region generated from the current image and a second region generated from the stored image, the second region not being visible within the current image.

## Claims

### Claim 1

A display method for use in a vehicle, the method comprising:
capturing images of a region external to the vehicle;
storing at least a portion of the captured images;
generating a composite image from a current image and a stored image by matching portions of the stored image and the current image; and
displaying at least part of the composite image;
wherein the composite image comprises a first region generated from the current image and a second region generated from the stored image, the second region not being visible within the current image.

### Claim 2 (depends on 1)

A display method according to claim 1, wherein the composite image comprises a 3-Dimensional (3D) representation or a 2-Dimensional (2D) representation of the environment surrounding the vehicle and extending at least partially underneath the vehicle.

### Claim 3 (depends on 2)

A display method according to claim 2, wherein displaying at least part of the composite image comprises generating a 2D representation of at least a portion of the 3D representation and displaying the 2D representation.

### Claim 4 (depends on 1)

A display method according to claim 1, wherein the captured image data comprises a series of image frames; and wherein the method further comprises:
determining a position of the vehicle; and
storing an indication of the position of the vehicle with at least a portion of an image frame.

### Claim 5 (depends on 1)

A display method according to claim 1, wherein matching portions of the stored image and the current image comprises matching overlapping portions of the stored image and the current image.

### Claim 6 (depends on 1)

A display method according to claim 1, wherein matching portions of the stored image and the current image comprises performing pattern matching to identify features present in both the stored image and the current image such those features are correlated in the composite image.

### Claim 7 (depends on 5)

A display method according to claim 5, further comprising:
determining a pattern recognition region including an area which is not visible within the current image; and
determining a stored image including image data for the environment within the pattern recognition area.

### Claim 8 (depends on 7)

A display method according to claim 7, wherein determining a pattern recognition region comprises determining coordinates for the pattern recognition region according to a current position of the vehicle.

### Claim 9 (depends on 8)

A display method according to claim 8, wherein determining a pattern recognition region further includes receiving a signal indicating an orientation of the vehicle and adjusting the pattern recognition region coordinates according to the vehicle orientation.

### Claim 10 (depends on 1)

A display method according to claim 1, wherein storing at least a portion of the captured image comprises:
storing a first captured image frame;
determining a degree of overlap between the first captured image frame and a second captured image frame; and
for the second captured image frame storing a non-overlapping portion of the second image frame.

### Claim 11 (depends on 1)

A display method according to claim 1, wherein the composite image includes image data from multiple current images representing different views from the vehicle and at least one stored image such that the composite image comprises a contiguous view of at least a portion of the environment surrounding the vehicle and extending underneath the vehicle.

### Claim 12 (depends on 1)

A display method according to claim 1, further comprising obtaining information associated with the vehicle and displaying a graphical representation of at least one component of the vehicle within the composite image.

### Claim 13 (depends on 12)

A display method according to claim 12, wherein the information associated with the vehicle is information associated with the at least one component of the vehicle, the at least one component of the vehicle comprising at least one selected from a group consisting of:
a steering system of the vehicle;
one or more wheels of the vehicle;
a suspension of the vehicle or an engine of the vehicle; and
a further mechanical component of the vehicle.

### Claim 14 (depends on 1)

A display method according to claim 1, wherein the composite image is displayed to overlie a portion of the vehicle to be indicative of a portion of the vehicle being at least partly transparent.

### Claim 15 (depends on 1)

A display method according to claim 1, wherein the composite image is displayed to be translucent or overlies an internal or external vehicle portion.

### Claim 16 (depends on 1)

A display method according to claim 1, wherein the image data is obtained from one or more cameras associated with the vehicle and arranged to capture images of the environment surrounding the vehicle.

### Claim 17 (depends on 1)

A computer program product storing computer program code which is arranged when executed to implement the method of claim 1.

### Claim 18

A display apparatus for use with a vehicle, comprising:
image capture means arranged to capture images of a region external to the vehicle;
a display means arranged to display information;
a storage means arranged to store at least a portion of the captured images; and
a processing means arranged to:
receive a current image from the image capture means;
cause the storage means to store at least a portion of the captured images;
generate a composite image from a current image and a stored image by matching portions of stored image and current image; and
cause the display means to display at least part of the composite image;
wherein the composite image comprises a first region generated from the current image and a second region generated from the stored image, the second region not being visible within the current image.

### Claim 19

(canceled)

### Claim 20 (depends on 18)

A vehicle comprising the display apparatus of claim 18.

### Claim 21

(canceled)
