# US 2022/0284544 A1 · Vehicle undercarriage imaging

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2022/0284544 A1
- Document ID: US20220284544A1
- Status: Published application
- Kind: A1
- Application number: 17/190,268
- Filed: 2021-03-02
- Published: 2022-09-08
- Earliest claimed: 2021-03-02
- Assignees: Fyusion, Inc.
- Applicants: Fyusion, Inc.
- Inventors: Stefan Johannes Josef Holzer; Krunal Ketan Chande; Matteo Munaro; Pavel Hanchar; Aidas Liaudanskas; Wook Yeon Hwang; Blake McConnell; Johan Nordin; Milos Vlaski; Martin Markus Hubert Wawro; Nick Stetco; Martin Saelzle
- Web page: https://patentgrep.com/patent/US20220284544A1

## CPC

- G06T 3/4038: Image mosaicing, e.g. composing plane images from plane sub-images
- G06T 7/0004: {Industrial image inspection}
- G06T 7/50: Depth or shape recovery
- G06T 2207/10028: Range image; Depth image; 3D point clouds
- G06T 2207/20221: Image fusion; Image merging
- G06T 2207/30252: Vehicle exterior; Vicinity of vehicle
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL

## Abstract

Images of an undercarriage of a vehicle may be captured via one or more cameras. A point cloud may be determined based on the images. The point cloud may includes points positioned in a virtual three-dimensional space. A stitched image may be determined based on the point cloud by projecting the point cloud onto a virtual camera view. The stitched image may be stored on a storage device

## Claims

### Claim 1

A method comprising:
capturing a plurality of images of an undercarriage of a vehicle, the images captured via one or more cameras, each camera being arranged in a respective fixed position, the images being captured as the vehicle moves over the one or more cameras;
determining a designated point cloud based on the plurality of images via a processor, the designated point cloud including a plurality of points positioned in a virtual three-dimensional space;
determining a designated stitched image based on the designated point cloud via the processor, wherein the stitched image is determined by projecting the designated point cloud onto a virtual camera view; and
storing the designated stitched image on a storage device.

### Claim 2 (depends on 1)

The method recited in claim 1, wherein the virtual camera view is a two-dimensional plane in the virtual three-dimensional space.

### Claim 3 (depends on 1)

The method recited in claim 1, wherein the virtual camera view is a point in the virtual three-dimensional space.

### Claim 4 (depends on 1)

The method recited in claim 1, wherein determining the designated point cloud comprises determining a plurality of point clouds.

### Claim 5 (depends on 4)

The method recited in claim 4, wherein the one or more cameras includes a plurality of cameras, and wherein each of the point clouds corresponds with a respective one of the cameras.

### Claim 6 (depends on 4)

The method recited in claim 4, wherein each of the point clouds corresponds with a respective one of the images.

### Claim 7 (depends on 1)

The method recited in claim 1, wherein the designated point cloud is determined based at least in part on depth information captured from one or more depth sensors.

### Claim 8 (depends on 1)

The method recited in claim 1, wherein determining the stitched image comprises identifying a plurality of correspondence points, each of the correspondence points indicating a visual feature included in two or more of the plurality of images.

### Claim 9 (depends on 8)

The method recited in claim 8, wherein determining the stitched image further comprises identifying a plurality of point correspondence transformations, each of the point correspondence transformations identifying a respective spatial relationship between a first location of a designated one of the correspondence points in a first one of the images and a second location of the designated correspondence point in a second one of the images.

### Claim 10 (depends on 9)

The method recited in claim 9, wherein determining the stitched image further comprises determining an image correspondence providing a mathematical transformation between the first and second images in a two or three dimensional coordinate space based on the plurality of correspondence transformations.

### Claim 11 (depends on 10)

The method recited in claim 10, wherein the image correspondence is a numerical average of one or more of the point correspondence transformations, the numerical average determined based on a cost function.

### Claim 12 (depends on 1)

The method recited in claim 1, wherein the designated stitched image is one of a plurality of stitched images determined based on the designated point cloud.

### Claim 13 (depends on 1)

The method recited in claim 1, the method further comprising generating a multi-view interactive digital media representation that includes the plurality of stitched images, the multi-view interactive digital media representation being navigable in one or more dimensions.

### Claim 14 (depends on 13)

The method recited in claim 13, wherein the multi-view interactive digital media representation being navigable in three dimensions.

### Claim 15

A system comprising:
one or more cameras configured to capture a plurality of images of an undercarriage of a vehicle, each camera being arranged in a respective fixed position, the images being captured as the vehicle moves over the one or more cameras;
a processor configured to determine a designated point cloud based on the plurality of images and determine a designated stitched image based on the designated point cloud, the designated point cloud including a plurality of points positioned in a virtual three-dimensional space, wherein the stitched image is determined by projecting the designated point cloud onto a virtual camera view; and
a storage device configured to store the designated stitched image.

### Claim 16 (depends on 15)

The system recited in claim 15, wherein determining the stitched image comprises identifying a plurality of correspondence points, each of the correspondence points indicating a visual feature included in two or more of the plurality of images, wherein determining the stitched image further comprises identifying a plurality of point correspondence transformations, each of the point correspondence transformations identifying a respective spatial relationship between a first location of a designated one of the correspondence points in a first one of the images and a second location of the designated correspondence point in a second one of the images, wherein determining the stitched image further comprises determining an image correspondence providing a mathematical transformation between the first and second images in a two or three dimensional coordinate space based on the plurality of correspondence transformations, and wherein the image correspondence is a numerical average of one or more of the point correspondence transformations, the numerical average determined based on a cost function.

### Claim 17 (depends on 15)

The system recited in claim 15, wherein the processor is further operable to generate a multi-view interactive digital media representation that includes the plurality of stitched images, the multi-view interactive digital media representation being navigable in one or more dimensions.

### Claim 18 (depends on 15)

The system recited in claim 15, wherein determining the designated point cloud comprises determining a plurality of point clouds, and wherein the one or more cameras includes a plurality of cameras, and wherein each of the point clouds corresponds with a respective one of the cameras.

### Claim 19 (depends on 1)

The system recited in claim 1, wherein the virtual camera view is a two-dimensional plane or a point in the virtual three-dimensional space.

### Claim 20

One or more non-transitory computer readable media having instructions stored thereon for performing a method, the method comprising:
capturing a plurality of images of an undercarriage of a vehicle, the images captured via one or more cameras, each camera being arranged in a respective fixed position, the images being captured as the vehicle moves over the one or more cameras;
determining a designated point cloud based on the plurality of images via a processor, the designated point cloud including a plurality of points positioned in a virtual three-dimensional space;
determining a designated stitched image based on the designated point cloud via the processor, wherein the stitched image is determined by projecting the designated point cloud onto a virtual camera view; and
storing the designated stitched image on a storage device.
